Skip to content

Instantly share code, notes, and snippets.

@b0noI

b0noI/nltk_prep.py

Created May 28, 2018 20:00
Show Gist options
  • Save b0noI/9c6ff272c813dab5f4a4869597771007 to your computer and use it in GitHub Desktop.
Save b0noI/9c6ff272c813dab5f4a4869597771007 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
nltk_prep.py
import nltk
dwlr = nltk.downloader.Downloader()
for pkg in dwlr.packages():
if pkg.subdir== 'tokenizers':
dwlr.download(pkg.id)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment