Skip to content

Instantly share code, notes, and snippets.

@rspeer
Created October 28, 2015 23:32
Show Gist options
  • Save rspeer/0a5dc7e6983d2ce752b5 to your computer and use it in GitHub Desktop.
Save rspeer/0a5dc7e6983d2ce752b5 to your computer and use it in GitHub Desktop.
>>> from wordfreq import tokenize, word_frequency
>>> tokenize('电影放映机', 'zh')
['电影', '放映', '机']
>>> word_frequency('电影放映机', 'zh')
5.370851923771552e-08
>>> word_frequency('programme', 'en')
5.754399373371567e-05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment