# But what is cross-entropy? | Compression is Intelligence Part 2

> Полный текст доступен на английском

**Published:** 16 июля 2026 г.
**Author:** 3Blue1Brown
**Source:** YouTube — Andrej Karpathy
**Language:** en-US
**HTML:** https://aiqazaqstan.com/ru/articles/but-what-is-cross-entropy-compression-is-intelligence-part-2

Where the loss function for training LLMs comes from. Job opportunities aligned to this audience: https://3b1b.co/talent Early views and other perks for supporters: https://3b1b.co/support Home page: https://www.3blue1brown.com Part 1: https://youtu.be/l6DKRf-fAAM If you want to…

> Материал агрегирован из первоисточника: **YouTube — Andrej Karpathy**
> [Читать полностью в YouTube — Andrej Karpathy](https://www.youtube.com/watch?v=GlYgs6v2YfU)

**Теги:** #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*