Skip to content

Instantly share code, notes, and snippets.

@y2k-shubham

y2k-shubham/clean_windows_text_file.sh

Created March 31, 2020 12:53
Show Gist options
  • Save y2k-shubham/66fe3736a96295fd6728e36071da805f to your computer and use it in GitHub Desktop.
Save y2k-shubham/66fe3736a96295fd6728e36071da805f to your computer and use it in GitHub Desktop.
Download ZIP
clean text-files generated in windows for programmatic consumption in linux
Raw
clean_windows_text_file.sh
# Removes invisible characters (like formfeed)
# also coerces UTF-8 encoding
iconv -c -f utf-8 -t ascii source_filename.csv > destination_filename.csv
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment