Skip to content

Instantly share code, notes, and snippets.

@philtomson
Created January 9, 2019 01:35
Show Gist options
  • Save philtomson/745d4798fae6e99b9388d08bca3fb553 to your computer and use it in GitHub Desktop.
Save philtomson/745d4798fae6e99b9388d08bca3fb553 to your computer and use it in GitHub Desktop.
matrix sizes
#RNN data sizes:
# x.size() = [64x1000]
f[0] = self.get_f(dag[-1][0].name) # activation func
c[0] = F.sigmoid(self.w_xc(x) + F.linear(h_prev, self.w_hc, None))
h[0] = (c[0]*f[0](self.w_xh(x) + F.linear(h_prev, self.w_hh, None)) +
(1 - c[0])*h_prev)
#h_prev.size() = [64x1000]
#self.w_hc.size() = [1000,1000]
#self.w_xh(x).size= [64x1000]
#self.w_xc(x).size= [64x1000]
#self.w_hh.size() = [1000,1000]
#c[0].size() = [64x1000]
#h[0].size() = [64x1000]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment