Avril Aysha avriiil
avriiil
/ reduce_ortho_ambiguity.py
Created
April 5, 2021 19:19
Function to reduce orthographic ambiguity of Arabic text
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from camel_tools.utils.normalize import normalize_alef_maksura_ar | |
| from camel_tools.utils.normalize import normalize_alef_ar | |
| from camel_tools.utils.normalize import normalize_teh_marbuta_ar | |
| def ortho_normalize(text): | |
| text = normalize_alef_maksura_ar(text) | |
| text = normalize_alef_ar(text) | |
| text = normalize_teh_marbuta_ar(text) | |
| return text | |
NewerOlder