# The GELU, SiLU and SwiGLU activation functions, clearly explained!!!

**Published:** October 14, 2026
**Author:** StatQuest with Josh Starmer
**Source:** YouTube — StatQuest AI
**Language:** en-US
**HTML:** https://aiqazaqstan.com/en/articles/the-gelu-silu-and-swiglu-activation-functions-clearly-explained

Sometimes drop out is all you [music and singing] need. Hooray! StatQuest. Hello, I'm Josh Starmer and welcome to StatQuest. Today we're going to talk about the GELU, SELU, and SWIGLU activation functions and they're going to be clearly explained. This StatQuest is brought to…

> From the original source: **YouTube — StatQuest AI**
> [Read full article at YouTube — StatQuest AI](https://www.youtube.com/watch?v=2FaI2Fen1mQ)

**Tags:** #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*