Exercise - Activation Functions

In this notebook we will have a look at activation functions, the second fundamental concept of neurons.

8KB

Activation Functions.ipynb

Download this notebook and implement the missing parts. You will have to implement four of the most common activations functions: Sigmoid, TanH, ReLU and LeakyReLU. The implemented activation functions should look like this:

Sigmoid

TanH

ReLU

LeakyReLU