# Transformers, the tech behind LLMs | Deep Learning Chapter 5

**Published:** October 14, 2026
**Author:** 3Blue1Brown
**Source:** YouTube — 3Blue1Brown
**Language:** en-US
**HTML:** https://aiqazaqstan.com/en/articles/transformers-the-tech-behind-llms-deep-learning-chapter-5

The initials GPT stand for Generative Pretrained Transformer. So that first word is straightforward enough, these are bots that generate new text. Pretrained refers to how the model went through a process of learning from a massive amount of data, and the prefix insinuates that…

> From the original source: **YouTube — 3Blue1Brown**
> [Read full article at YouTube — 3Blue1Brown](https://www.youtube.com/watch?v=wjZofJX0v4M)

**Tags:** #OpenAI #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*