dinks/test.sh

Created May 29, 2019 13:51

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/dinks/631ef777bdfa7f900a9bcc7c032e310b.js"></script>
Save dinks/631ef777bdfa7f900a9bcc7c032e310b to your computer and use it in GitHub Desktop.

Download ZIP

Remove duplicates from File preserving order

Raw

test.sh

awk '!visited[$0]++' your_file > deduplicated_file

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment