Skip to content

Instantly share code, notes, and snippets.

@johannesboyne

johannesboyne/crunchwikilogs.sh

Created May 15, 2014 17:55
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save johannesboyne/c21e7eb396897a0897e2 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save johannesboyne/c21e7eb396897a0897e2 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
crunchwikilogs.sh
awk '{pages += $3; bytes += $4} END {print pages, bytes}' pagecounts-20140501-110000 | awk '{gtp += $1; gtb += $2} END {print "Total # of Pages: " gtp, "Total # of Bytes requested: " gtb}'
@johannesboyne
Copy link
Author

johannesboyne commented May 15, 2014

Source: http://dumps.wikimedia.org/other/pagecounts-raw/2014/2014-05/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment