# But what is cross-entropy? | Compression is Intelligence Part 2

> 全文为英语

**Published:** 2026年7月16日
**Author:** 3Blue1Brown
**Source:** YouTube — Andrej Karpathy
**Language:** en-US
**HTML:** https://aiqazaqstan.com/zh/articles/but-what-is-cross-entropy-compression-is-intelligence-part-2

Where the loss function for training LLMs comes from. Job opportunities aligned to this audience: https://3b1b.co/talent Early views and other perks for supporters: https://3b1b.co/support Home page: https://www.3blue1brown.com Part 1: https://youtu.be/l6DKRf-fAAM If you want to…

> 内容来自原始来源： **YouTube — Andrej Karpathy**
> [在 YouTube — Andrej Karpathy 阅读全文](https://www.youtube.com/watch?v=GlYgs6v2YfU)

**标签：** #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*