Skip to content

Instantly share code, notes, and snippets.

@spiderChow
Last active December 11, 2017 08:35
Show Gist options
  • Select an option

  • Save spiderChow/2307fb1077a26c31d4aac16863c8c391 to your computer and use it in GitHub Desktop.

Select an option

Save spiderChow/2307fb1077a26c31d4aac16863c8c391 to your computer and use it in GitHub Desktop.
dialog
给定一问一答 post & response
似然为p(post,resp)
p(post,resp) = p(post) x p(resp|post)
训练: loss function = -logp(resp|post) [交叉熵 伯努利分布]
测试:使p(resp|post)最大的resp [post已经给定]
dialog & vae
由vae得知,一个样本点的似然:
##log p(post,resp)>= L = -KL (q(z|post,resp)||p(z)) + E_{z~q} log p(post,resp|z)
log p(resp | post)>= L = -KL (q(z|resp,post)||p(z|post)) + E_{z~q} log p(resp|z, post)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment