# Building makemore Part 3: Activations & Gradients, BatchNorm

> 全文为英语

**Published:** 2026年10月14日
**Author:** Andrej Karpathy
**Source:** YouTube — Andrej Karpathy
**Language:** en-US
**HTML:** https://aiqazaqstan.com/zh/articles/building-makemore-part-3-activations-gradients-batchnorm

hi everyone today we are continuing our implementation of make more now in the last lecture we implemented the multier perceptron along the lines of benj 2003 for character level language modeling so we followed this paper took in a few characters in the past and used an MLP to…

> 内容来自原始来源： **YouTube — Andrej Karpathy**
> [在 YouTube — Andrej Karpathy 阅读全文](https://www.youtube.com/watch?v=P6sfmUTpUmc)

**标签：** #GPU & Суперкомпьютеры #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*