# Measuring the entropy of English

> 全文为英语

**Published:** 2026年6月12日
**Author:** 3Blue1Brown
**Source:** YouTube — Andrej Karpathy
**Language:** en-US
**HTML:** https://aiqazaqstan.com/zh/articles/measuring-the-entropy-of-english

Claude Shannon figured out how the compressibility of English text depends on how predictable it is, so he made multiple attempts at understanding the probability of each new character in English. His earliest experiments involved looking at specific short sequences of…

> 内容来自原始来源： **YouTube — Andrej Karpathy**
> [在 YouTube — Andrej Karpathy 阅读全文](https://www.youtube.com/shorts/-7etvZSBxlk)

**标签：** #Anthropic #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*