Skip to content

Instantly share code, notes, and snippets.

@spikeninja

spikeninja/ukrainian_text_cleaning.py

Created May 3, 2021 12:44
Show Gist options
  • Save spikeninja/68f51b4bc4bb5970db10987376b138b8 to your computer and use it in GitHub Desktop.
Save spikeninja/68f51b4bc4bb5970db10987376b138b8 to your computer and use it in GitHub Desktop.
Download ZIP
Github
Raw
ukrainian_text_cleaning.py
def clean_text(text):
cleaned_str = re.sub('[^а-яїіґє\\s]+', '',text,flags=re.IGNORECASE)
cleaned_str = re.sub('(\\s+)', ' ',cleaned_str)
cleaned_str = cleaned_str.lower()
return cleaned_str
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment