Skip to content

Instantly share code, notes, and snippets.

@acook
Last active December 11, 2015 18:28
Show Gist options
  • Save acook/4641728 to your computer and use it in GitHub Desktop.
Save acook/4641728 to your computer and use it in GitHub Desktop.
## Single pass
$ time bin/rivalry ..
-- Size : 299 MB
-- Count : 1456 files
-- Dupes : 301 files
real 0m2.604s
user 0m2.435s
sys 0m0.163s
## Two pass
$ time bin/rivalry ..
-- Total Size : 299 MB
-- Total Count : 2072 files
-- Similar : 1213 files with the same size
-- Dupes Count : 917 files
real 0m0.681s
user 0m0.591s
sys 0m0.086s
## Two pass is much faster as long as a certain threshhold of identically sized files isn't reached
## Apparently my file counts were also wrong in the 1-pass algo, oops
$ time bin/rivalry ~/Music/
Scanning all files...
-- Total Size : 74 GB
-- Total Count : 8644 files
Determining duplicates...
-- Dupes Count : 5092 files
real 5m20.102s
user 4m46.608s
sys 0m17.296s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment