Ramos waterzxj

NLP/deep-learning/ml

waterzxj / gist:79c91818099315cc0fdb3cbb853d01d3

Created January 2, 2018 14:35 — forked from karpathy/gist:587454dc0146a6ae21fc

An efficient, batched LSTM.

	"""
	This is a batched LSTM forward and backward pass
	"""
	import numpy as np
	import code

	class LSTM:

	@staticmethod
	def init(input_size, hidden_size, fancy_forget_bias_init = 3):

waterzxj / min-char-rnn.py

Created December 6, 2017 01:08 — forked from karpathy/min-char-rnn.py

Minimal character-level language model with a Vanilla Recurrent Neural Network, in Python/numpy

	"""
	Minimal character-level Vanilla RNN model. Written by Andrej Karpathy (@karpathy)
	BSD License
	"""
	import numpy as np

	# data I/O
	data = open('input.txt', 'r').read() # should be simple plain text file
	chars = list(set(data))
	data_size, vocab_size = len(data), len(chars)