Last active
October 14, 2019 18:03
-
-
Save negedng/a19e9db7ffb266bbeaffd3bea0eddc9d to your computer and use it in GitHub Desktop.
BLEU and BERT scores on pocket sentences
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sentence | BLEU | BLEUw2 | BertED | BertED* | BertCS | SpacyS | |
---|---|---|---|---|---|---|---|
James Cook was a very good man and a loving husband. | 1.0 | 1.0 | 0.0 | 1.0 | 1.0 | 1.0 | |
James Cook was a very nice man and a loving husband. | 0.735 | 0.761 | 1.298 | 0.789 | 0.996 | 0.997 | |
James Cook was a bad man and a terrible husband. | 0.342 | 0.425 | 3.907 | 0.490 | 0.965 | 0.971 | |
James Cook was a nice person and a good husband. | 0.295 | 0.381 | 2.258 | 0.663 | 0.988 | 0.982 | |
The sky is blue today and learning history is important. | 0.639 | 0.115 | 6.831 | 0.288 | 0.891 | 0.801 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment