Skip to content

Instantly share code, notes, and snippets.

@sobamchan
Created November 5, 2019 12:53
Show Gist options
  • Save sobamchan/b716a7cdb59cd8f2acc1c88199debd7e to your computer and use it in GitHub Desktop.
Save sobamchan/b716a7cdb59cd8f2acc1c88199debd7e to your computer and use it in GitHub Desktop.
import lineflow.datasets as lfds

train = lfds.MsrParaphrase('train')
test = lfds.MsrParaphrase('test')

The item in this dataset as follows:

>>> import lineflow.datasets as lfds
>>> train = lfds.MsrParaphrase('train')
>>> train.first()
{'quality': '1',
 'id1': '702876',
 'id2': '702977',
 'string1': 'Amrozi accused his brother, whom he called "the witness", of deliberately distorting his evidence.',
 'string2': 'Referring to him as only "the witness", Amrozi accused his brother of deliberately distorting his evidence.'
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment