Last active
November 6, 2022 18:53
-
-
Save eamartin/d7f1f71e5ce54112fe05e2f2f17ebedf to your computer and use it in GitHub Desktop.
Understanding & Visualizing Self-Normalizing Neural Networks
Nice work!
Brilliant :) Very clear.
Was wondering if this also worked for convolutional networks, so added a section to this notebook with a conv2d experiment. It's here: https://gist.github.com/gngdb/a122ae86c0b897cffebdb9481e321c9d
Recall the special property of the activation function is to map ... Var[h] = 0
Don't you mean Var[h] = 1?
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Awesome