# Let's build the GPT Tokenizer

> Толық мәтін ағылшын тілінде

**Published:** 2026 ж. 14 қазан
**Author:** Andrej Karpathy
**Source:** YouTube — Andrej Karpathy
**Language:** en-US
**HTML:** https://aiqazaqstan.com/kk/articles/let-s-build-the-gpt-tokenizer

hi everyone so in this video I'd like us to cover the process of tokenization in large language models now you see here that I have a set face and that's because uh tokenization is my least favorite part of working with large language models but unfortunately it is necessary to…

> Материал бастапқы дереккөзден алынған: **YouTube — Andrej Karpathy**
> [Толық мәтінді YouTube — Andrej Karpathy сайтында оқу](https://www.youtube.com/watch?v=zduSFxRajkE)

**Тегтер:** #OpenAI #Papers with Code #Meta AI #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*