Skip to content

Instantly share code, notes, and snippets.

@nelhage
Created June 11, 2013 23:55
Show Gist options
  • Save nelhage/5761859 to your computer and use it in GitHub Desktop.
Save nelhage/5761859 to your computer and use it in GitHub Desktop.
[nelhage@aeronautique:/tmp]$ curl -s 'http://pastebin.com/raw.php?i=dAybWC0C' -o urls.raw
[nelhage@aeronautique:/tmp]$ tr -d '\r' < urls.raw | sed 's,\?.*,,' | sort -u > urls.uniq
[nelhage@aeronautique:/tmp]$ wc -l urls.uniq
750 urls.uniq
[nelhage@aeronautique:/tmp]$ perl -lane 'print $1 if m{/(\d{4}/\d{2}/\d{2})/}' urls.uniq | sort | uniq -c | sort -rn | head
131 2013/06/11
116 2013/06/09
61 2013/06/12
45 2013/06/10
38 2013/06/06
30 2013/06/07
23 2013/06/08
22 2013/06/05
16 2013/06/02
11 2013/06/04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment