From the original source:
YouTube — Andrej Karpathy
Read full article at YouTube — Andrej KarpathyThis material was compiled from public sources. If its publication affects your rights → Request removal
But what is cross-entropy? | Compression is Intelligence Part 2
There's a kind of wild paper from 2002 called Language Trees and Zipping, which shows how you can find structure between languages just by using very general file compression. For example, let's say I give you a bunch of text documents in many different languages, and your goal…
AI Summary & Key Takeaways
- There's a kind of wild paper from 2002 called Language Trees and Zipping, which shows how you can find structure between languages just by using very general file compression
- For example, let's say I give you a bunch of text documents in many different languages, and your goal…
Related stories
Sam Altman Reveals OpenAI's FINAL PLAN (It's Insane)
Sam Alman, the CEO of OpenAI, the company behind ChatGpt, just told his own employees that there are only three ways this whole AI race can end. And one of those endings is a single company getting so powerful that it can literally melt everyone else's GPUs. This is not a…
Learn to build to better AI Agents through better Context
Learn More: https://bit.ly/4yy5iWP The longer an agent works, the more repeated, contradictory, or stale information builds up in its context. Models perform worse as their context grows, a problem Jeff Huber and his team at Chroma named Context Rot. In our new course, Context…
Giannis x Google Search: Miami Pickup Hoops
Live from the 305. I've been in Miami for a minute. I haven’t seen no streetball. [a player shouting] Let's go! That's what I'm talking about. [Giannis continues] Let's see what Google Search can do. [Giannis voicing the query] Okay. [Giannis continues] José Martí. Okay. Yes,…
October 2026
People are like, “What are you always busy with?” Guys, I'm a wipe coder. I like to see how well Klod writes code. I like to tell you what I wiped over the weekend. I like to think that I'm still a nawipe-codi. I love starting a startup and not finishing it. I have these...