The GELU, SiLU and SwiGLU activation functions, clearly explained!!!

Description

Sometimes drop out is all you [music and singing] need. Hooray! StatQuest. Hello, I'm Josh Starmer and welcome to StatQuest. Today we're going to talk about the GELU, SELU, and SWIGLU activation functions and they're going to be clearly explained. This StatQuest is brought to…