Skip to content

Instantly share code, notes, and snippets.

@szydan
Last active June 19, 2024 13:13
Show Gist options
  • Save szydan/b225749445b3602083ed to your computer and use it in GitHub Desktop.
Save szydan/b225749445b3602083ed to your computer and use it in GitHub Desktop.
<U+FEFF> character showing up in files. How to remove them?
1) In your terminal, open the file using vim:
vim file_name
2) Remove all BOM characters:
:set nobomb
3) Save the file:
:wq
// taken from:
http://stackoverflow.com/questions/7297888/ufeff-character-showing-up-in-files-how-to-remove-them
Another recipe using awk
http://stackoverflow.com/questions/1068650/using-awk-to-remove-the-byte-order-mark
awk '{ if (NR==1) sub(/^\xef\xbb\xbf/,""); print }' INFILE > OUTFILE
@tlhenvironment
Copy link

thamks

@gogoprog
Copy link

In a script:

#!/bin/bash

awk '{ gsub(/\xef\xbb\xbf/,""); print }' $1 > /tmp/feff && mv /tmp/feff $1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment