- The first mention I found to ReLU is in Fukushima's paper from 1975: Cognitron: A self-organizing multilayered neural network | SpringerLink
- Nair and Hinton paper from 2010 make the case that ReLU preserves information during backpropagation Rectified Linear Units Improve Restricted Boltzmann Machines
- Why is the ReLU function not differentiable at x=0?
- Deep Learning with Python - François Chollet
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
### JHW 2018 | |
import numpy as np | |
import umap | |
# This code from the excellent module at: | |
# https://stackoverflow.com/questions/4643647/fast-prime-factorization-module | |
import random |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/bash | |
# author: Leon van Kammen / Coder of Salvation 2014 | |
# | |
# restconsole, a simple curl REST api wrapper for bash | |
rooturl="http://api.yourcompany.com" | |
apikey="e270f99745341a89e883c583a25b821c" | |
cache=() | |
# here you can define your preset calls |
The git command-line utility has plenty of inconsistencies http://steveko.wordpress.com/2012/02/24/10-things-i-hate-about-git/
A GUI like http://sourcetreeapp.com is often helpful, but staying on the command line usually quicker. This is a list of the commands I use most frequently, listed by functional category:
git status
list which (unstaged) files have changed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
/* | |
* I add this to html files generated with pandoc. | |
*/ | |
html { | |
font-size: 100%; | |
overflow-y: scroll; | |
-webkit-text-size-adjust: 100%; | |
-ms-text-size-adjust: 100%; | |
} |