# Building makemore Part 3: Activations & Gradients, BatchNorm

**Published:** October 14, 2026
**Author:** Andrej Karpathy
**Source:** YouTube — Andrej Karpathy
**Language:** en-US
**HTML:** https://aiqazaqstan.com/en/articles/building-makemore-part-3-activations-gradients-batchnorm

hi everyone today we are continuing our implementation of make more now in the last lecture we implemented the multier perceptron along the lines of benj 2003 for character level language modeling so we followed this paper took in a few characters in the past and used an MLP to…

> From the original source: **YouTube — Andrej Karpathy**
> [Read full article at YouTube — Andrej Karpathy](https://www.youtube.com/watch?v=P6sfmUTpUmc)

**Tags:** #GPU & Суперкомпьютеры #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*