Chong Wu ChongWu-Biostat

I am an Assistant Professor at MD Anderson Cancer Center. My research interest is statistical genetics, causal inference, and machine learning.

jeremyjordan / sgdr.py

Last active December 4, 2023 13:41

Keras Callback for implementing Stochastic Gradient Descent with Restarts

	from keras.callbacks import Callback
	import keras.backend as K
	import numpy as np

	class SGDRScheduler(Callback):
	'''Cosine annealing learning rate scheduler with periodic restarts.

	# Usage
	```python
	schedule = SGDRScheduler(min_lr=1e-5,