# Let's reproduce GPT-2 (124M)

**Published:** October 14, 2026
**Author:** Andrej Karpathy
**Source:** YouTube — Andrej Karpathy
**Language:** en-US
**HTML:** https://aiqazaqstan.com/en/articles/let-s-reproduce-gpt-2-124m

hi everyone so today we are going to be continuing our Zero to Hero series and in particular today we are going to reproduce the gpt2 model the 124 million version of it so when openi released gpt2 this was 2019 and they released it with this blog post on top of that they…

> From the original source: **YouTube — Andrej Karpathy**
> [Read full article at YouTube — Andrej Karpathy](https://www.youtube.com/watch?v=l8pRSuU81PU)

**Tags:** #OpenAI #Papers with Code #Hugging Face #Nvidia #GPU & Суперкомпьютеры #Meta AI #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*