2KAbhishek/remove_dup.sh

Created August 6, 2019 03:45

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/2KAbhishek/55a58938065e20202df906cf4a2ca20b.js"></script>
Save 2KAbhishek/55a58938065e20202df906cf4a2ca20b to your computer and use it in GitHub Desktop.

Download ZIP

Remove duplicate lines from file

Raw

remove_dup.sh

	#Remove duplicate lines
	awk '!visited[$0]++' old_file > new_file

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment