Removing duplicate files

find-duplicate-files-on-mac.md

Removes duplicates from a directory based on checksum

Find duplicates and write to duplicates-report.txt

find . -type f -exec cksum {} \; | sort | tee /tmp/f.tmp | cut -f 1,2 -d ' ' | uniq -d | grep -hif /dev/stdin /tmp/f.tmp > duplicates-report.txt

Delete duplicates based on duplicates-report.txt

sort -k1,1 duplicates-report.txt --stable | gawk -F' ' '{if ( $1==old ) { print $3 }; old=$1; }' > duplicates-only.txt | xargs rm