Skip to content

Instantly share code, notes, and snippets.

View b5's full-sized avatar

Brendan O'Brien b5

View GitHub Profile
@b5
b5 / kiwix.go
Last active May 11, 2017 20:43
Scrape Kiwix Urls
// Scrape info from kiwix service. This takes a little while to execute.
package main
import (
"encoding/json"
"github.com/PuerkitoBio/goquery"
"io/ioutil"
"log"
"net/http"
"os"
@b5
b5 / audit_full.json
Created April 28, 2017 16:21
epa dataset audit
This file has been truncated, but you can view the full file.
{
"name": "EPA",
"descendants": 18476,
"descendantsDownloadedOnce": 6860,
"descendantsArchivedOnce": 6842,
"children": [
{
"name": "https",
"descendants": 15278,
"descendantsDownloadedOnce": 5865,