victormurcia/tokenize_chapter.py

Created September 5, 2022 14:54

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/victormurcia/217e740f539ef46c9e0f71043fdd40fb.js"></script>
Save victormurcia/217e740f539ef46c9e0f71043fdd40fb to your computer and use it in GitHub Desktop.

Download ZIP

tokenize_chapter

Raw

tokenize_chapter.py

	chap_token = word_tokenize(contents)
	del(chap_token[0:2])

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment