Skip to content

Instantly share code, notes, and snippets.

@micahstubbs

micahstubbs/.block

Last active October 17, 2016 17:15
Show Gist options
  • Save micahstubbs/68c2091b07505e0995f7d341790d8f41 to your computer and use it in GitHub Desktop.
Save micahstubbs/68c2091b07505e0995f7d341790d8f41 to your computer and use it in GitHub Desktop.
Download ZIP
bl.ocks metadata
Raw
.block
license: MIT
border: no
Raw
README.md

a collection of bl.ocks metadata (and actual data)
download it, explore it, and make some visualizations 📈📊✨

the data is collected from github gists by the blockbuilder-search-index project. curious about just how you go about building a search index? you're in luck! there is a medium post and a tweet storm about this very thing

here are links to download the data in a few compression formats
followed by commands to extract the data for each format

bl.ocks metadata

expands to [77mb] on disk

[8.2mb] blocks-metadata-20161016.tar.bz2
tar -jxvf blocks-metadata-20161016.tar.bz2

[10mb] blocks-metadata-20161016.tar.gz
tar -zxvf blocks-metadata-20161016.tar.gz

[10mb] blocks-metadata-20161016.zip
unzip blocks-metadata-20161016.zip

blocks-metadata.png

all the files of all the blocks

expands to [8.4gb] on disk

[3gb] blocks-gists-clones-20161016.tar.bz2
tar -jxvf blocks-gists-clones-20161016.tar.bz2

[3.3gb] blocks-gists-clones-20161016.tar.gz
tar -zxvf blocks-gists-clones-20161016.tar.gz

[3.5gb] blocks-gists-clones-20161016.zip
unzip blocks-gists-clones-20161016.zip

all-the-gists.png

to compress

some instructions for my future self

.tar.bz2 | great compression

tar -jcvf archive-name.tar.bz2 folder-to-compress

.tar | decent compression

tar -zcvf archive-name.tar.gz folder-to-compress

.zip | -X to compress without Mac metadata files

zip -r -X archive-name.zip folder-to-compress

compression format reference page for commpressing file on a mac

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment