# But what is cross-entropy? | Compression is Intelligence Part 2

> Толық мәтін ағылшын тілінде

**Published:** 2026 ж. 16 шілде
**Author:** 3Blue1Brown
**Source:** YouTube — Andrej Karpathy
**Language:** en-US
**HTML:** https://aiqazaqstan.com/kk/articles/but-what-is-cross-entropy-compression-is-intelligence-part-2

Where the loss function for training LLMs comes from. Job opportunities aligned to this audience: https://3b1b.co/talent Early views and other perks for supporters: https://3b1b.co/support Home page: https://www.3blue1brown.com Part 1: https://youtu.be/l6DKRf-fAAM If you want to…

> Материал бастапқы дереккөзден алынған: **YouTube — Andrej Karpathy**
> [Толық мәтінді YouTube — Andrej Karpathy сайтында оқу](https://www.youtube.com/watch?v=GlYgs6v2YfU)

**Тегтер:** #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*