Skip to content

Instantly share code, notes, and snippets.

@kota7
kota7 / jumanpp-parallel-minibatch.py
Last active October 14, 2020 00:55
Apply JUMAN++ to many texts in parallel.
#!/usr/bin/env python
# coding: utf-8
"""
Apply JUMAN++ to many texts in parallel.
Requirements.
JUMAN++: http://nlp.ist.i.kyoto-u.ac.jp/index.php?JUMAN++
Python library:
mojimoji (https://github.com/studio-ousia/mojimoji) or