# But what is cross-entropy? | Compression is Intelligence Part 2

**Published:** July 16, 2026
**Author:** 3Blue1Brown
**Source:** YouTube — Andrej Karpathy
**Language:** en-US
**HTML:** https://aiqazaqstan.com/en/articles/but-what-is-cross-entropy-compression-is-intelligence-part-2

There's a kind of wild paper from 2002 called Language Trees and Zipping, which shows how you can find structure between languages just by using very general file compression. For example, let's say I give you a bunch of text documents in many different languages, and your goal…

> From the original source: **YouTube — Andrej Karpathy**
> [Read full article at YouTube — Andrej Karpathy](https://www.youtube.com/watch?v=GlYgs6v2YfU)

**Tags:** #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*