Skip to content

Instantly share code, notes, and snippets.

@emres

emres/gist:1494606

Created December 18, 2011 21:58
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save emres/1494606 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save emres/1494606 to your computer and use it in GitHub Desktop.
Download ZIP
Language detection in Bash command line
Raw
gistfile1.sh
en_res=$(echo $(cat some_en.txt EN | gzip | wc -c) - $(gzip -c EN | wc -c) | bc); \
de_res=$(echo $(cat some_en.txt DE | gzip | wc -c) - $(gzip -c DE | wc -c) | bc); \
(echo $en_res EN && echo $de_res DE) | sort -n | head -1 | cut -d' ' -f2
@shelomito12

shelomito12 commented Feb 4, 2022

Copy link
Copy Markdown

I get the following error in Ubuntu 20.04:

(standard_in) 1: illegal character: \342
(standard_in) 1: illegal character: \200
(standard_in) 1: illegal character: \223
(standard_in) 1: syntax error
(standard_in) 1: illegal character: \342
(standard_in) 1: illegal character: \200
(standard_in) 1: illegal character: \223
(standard_in) 1: syntax error
EN

Is there another easy linux command to detect language output ?

@emres

emres commented Feb 7, 2022

Copy link
Copy Markdown
Author

Hello, you might want to try Apache Tika or polyglot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment