Neural Network ExplAIned Series, Pt. 3: Activation Functions! (Part 1 is linked in this video, Part 2 linked from there…
From @harpercarrollai on Instagram — 622.2K followers · See full profile →
Neural Network ExplAIned Series, Pt. 3: Activation Functions! (Part 1 is linked in this video, Part 2 linked from there.) We didn’t cover this in the video, but they are called activation functions because they “activate” neurons to pass data forward. Perhaps in video 4 we can do an example of an actual activation function like ReLU, and see visually how it “activates” (and conversely de-activates) neurons as they pass data of a particular input through the neural network in the forward pass.…