Skip to content

Instantly share code, notes, and snippets.

@tridungduong16
Last active September 24, 2018 03:16
Show Gist options
  • Save tridungduong16/dbcd3112d0c5ff6e3d56dea644055ae0 to your computer and use it in GitHub Desktop.
Save tridungduong16/dbcd3112d0c5ff6e3d56dea644055ae0 to your computer and use it in GitHub Desktop.

Natural language processing

SVD (Singular Value Decomposition)

dungduong

  • A (mxn)

  • U (mxr)

  • D (rxr)

  • V (nxr)

  • U and V are orthonormal and the matrix D is diagonal with positive real entries

dungduong

NMF

There are two ways to avoid softmax:

Negative sampling

Hierachy softmax

References:

http://www.codecogs.com/latex/eqneditor.php

Terms

  • Diagonal matrix: ma trận bậc, ma trận đườnng chéo. Example
  • Orthonormal: ma trận trực giao
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment