Skip to content

Instantly share code, notes, and snippets.

@dewomser

dewomser/Dubletten_finden.md

Last active February 7, 2025 15:18
Show Gist options
  • Save dewomser/1837087605c31e405ee5f5355fcf20b5 to your computer and use it in GitHub Desktop.
Save dewomser/1837087605c31e405ee5f5355fcf20b5 to your computer and use it in GitHub Desktop.
Download ZIP
Dubletten finden mit Bash
Raw
Dubletten_finden.md

Finden von Dubletten mit md5 und xxh3

Ein Vergleich :

find . -type f -exec md5sum {} + | sort | uniq -w32 -Di

Ordner mit ca. 100 Videos durchsucht in 1 Minute 57 Sek ; 11 Treffer oder

find . -type f -exec xxhsum -H3 {} + | sort | uniq -w32 -Di

Ordner mit ca. 100 Videos durchsucht in 2 Minuten 21Sek ; 10 Treffer

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment