Last active
June 19, 2024 13:13
-
-
Save szydan/b225749445b3602083ed to your computer and use it in GitHub Desktop.
<U+FEFF> character showing up in files. How to remove them?
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
1) In your terminal, open the file using vim: | |
vim file_name | |
2) Remove all BOM characters: | |
:set nobomb | |
3) Save the file: | |
:wq | |
// taken from: | |
http://stackoverflow.com/questions/7297888/ufeff-character-showing-up-in-files-how-to-remove-them | |
Another recipe using awk | |
http://stackoverflow.com/questions/1068650/using-awk-to-remove-the-byte-order-mark | |
awk '{ if (NR==1) sub(/^\xef\xbb\xbf/,""); print }' INFILE > OUTFILE | |
thamks
In a script:
#!/bin/bash
awk '{ gsub(/\xef\xbb\xbf/,""); print }' $1 > /tmp/feff && mv /tmp/feff $1
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
awesome, many thanks for this gist! @Sebastian-D also thanks to you. i used your awk command to solve my problem :)