marrabld/costfunction.md

Last active September 26, 2018 06:06

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/marrabld/a58e571e4456d2ef3b59beb3fc6051b1.js"></script>
Save marrabld/a58e571e4456d2ef3b59beb3fc6051b1 to your computer and use it in GitHub Desktop.

Choosing the right cost function

Raw

    

Problem type
Last-layer activation
Loss function


Binary classification
sigmoid
binary_crossentropy

Multiclass, single-label classification
softmax
categorical_crossentropy

Multiclass, multilabel classification
sigmoid
binary_crossentropy

Regression to arbitrary values
None
mse

Regression to values between 0 and 1
sigmoid
mse or binary_crossentropy



  

Problem type	Last-layer activation	Loss function
Binary classification	sigmoid	binary_crossentropy
Multiclass, single-label classification	softmax	categorical_crossentropy
Multiclass, multilabel classification	sigmoid	binary_crossentropy
Regression to arbitrary values	None	mse
Regression to values between 0 and 1	sigmoid	mse or binary_crossentropy