Skip to content

Instantly share code, notes, and snippets.

View abaj8494's full-sized avatar

Aayush Bajaj abaj8494

View GitHub Profile
@abaj8494
abaj8494 / erf.py
Created April 16, 2025 08:16
error function as activation function
""" erf.py
~~~~~~~~~~
A doctored classification problem so that I can assert that the error function
works as a valid and better activation function than ReLU / Sigmoid.
erf tends to converge faster, but as you increase ``epochs`` and training size,
the classical ReLU / Tanh activation functions dominate:
~~~~~~~~~~
Training with ReLU activation