takuti
/ jawikicorpus.py
Last active
May 27, 2019 02:49
— forked from yuku/jawikicorpus.py
gensimに日本語Wikipediaを取り込むためのスクリプト
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # coding: utf-8 | |
| """USAGE: %(program)s WIKI_XML_DUMP OUTPUT_PREFIX | |
| """ | |
| import logging | |
| import os.path | |
| import sys | |
| import gensim.corpora.wikicorpus as wikicorpus |