Skip to content

Instantly share code, notes, and snippets.

@rizar
Last active March 30, 2018 17:17
Show Gist options
  • Save rizar/e6c1d529155fb61ef5c43ff9fcfeca95 to your computer and use it in GitHub Desktop.
Save rizar/e6c1d529155fb61ef5c43ff9fcfeca95 to your computer and use it in GitHub Desktop.
Predict question words from FiLM coefficients
Question: "Is there a cyan shiny thing of the same size as the block?"
No
Is there a cyan shiny thing of the same size as the block? no
FiLM layer 0
(size, 6.938) (the, 5.774) (same, 3.317) (there, 3.068) (as, 3.067) (cyan, 2.567) (Is, 0.406)
FiLM layer 1
(the, 6.826) (same, 4.392) (as, 4.130) (size, 3.484) (cyan, 2.280) (there, 2.038) (block, 0.408) (that, 0.262) (a, 0.135) (any, 0.112)
FiLM layer 2
(the, 9.060) (size, 4.601) (as, 3.907) (same, 2.995) (cyan, 1.927) (there, 1.653) (of, 0.022)
FiLM layer 3
(the, 10.127) (size, 4.724) (as, 4.486) (same, 3.654) (there, 3.378) (cyan, 1.800) (Is, 0.753) (any, 0.123)
Question: "Are there fewer tiny yellow cylinders than yellow metal cubes?"
No
FiLM layer 0
(yellow, 12.463) (than, 6.276) (there, 4.122) (Are, 2.267) (fewer, 1.274) (blocks, 0.914) (cubes, 0.670) (cylinders, 0.458)
FiLM layer 1
(than, 8.845) (yellow, 6.614) (there, 3.968) (Are, 3.018) (fewer, 2.999) (cylinders, 1.906) (cubes, 0.463) (blocks, 0.057)
FiLM layer 2
(yellow, 7.133) (than, 4.539) (there, 4.477) (Are, 0.702) (cylinders, 0.555) (cubes, 0.351)
FiLM layer 3
(than, 7.039) (yellow, 6.245) (there, 5.179) (fewer, 2.269) (Are, 1.836) (cubes, 1.028) (cylinders, 0.533) (blocks, 0.243) (are, 0.027)
Question: "How many brown things are big rubber balls or metallic cylinders?"
3
FiLM layer 0
(brown, 11.093) (or, 4.906) (cylinders, 3.493) (are, 2.862) (What, 0.483) (large, 0.208)
FiLM layer 1
(or, 3.693) (brown, 3.398) (are, 2.093) (cylinders, 0.797) (How, 0.512) (What, 0.423)
FiLM layer 2
(brown, 4.977) (or, 3.508) (are, 3.462) (cylinders, 2.408) (How, 0.551) (many, 0.026)
FiLM layer 3
(or, 4.438) (brown, 3.362) (are, 2.554) (cylinders, 1.012) (What, 0.046)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment