Skip to content

Instantly share code, notes, and snippets.

View mgermain's full-sized avatar

Mathieu Germain mgermain

  • horoma AI
  • Montreal
View GitHub Profile
@Newmu
Newmu / adam.py
Last active October 19, 2024 08:20
Adam Optimizer
"""
The MIT License (MIT)
Copyright (c) 2015 Alec Radford
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is