Skip to content

Instantly share code, notes, and snippets.

View darkarnium's full-sized avatar
💭
🔥

Peter darkarnium

💭
🔥
View GitHub Profile
@darkarnium
darkarnium / fetch_alexa.sh
Created December 5, 2016 03:34
Fetch Alexa 'Top 1,000,000' site list and munge into a list of domains only.
#!/bin/bash
ALEXA_STATIC_1M="http://s3.amazonaws.com/alexa-static/top-1m.csv.zip"
echo 'Attempting to fetch Alexa Top 1M archive...'
curl -o top-1m.csv.zip -s $ALEXA_STATIC_1M
if [ $? -ne 0 ]; then
echo 'FAILED: Count not fetch file from remote server.'
exit -1
fi
@darkarnium
darkarnium / eip_pricing.py
Created November 21, 2016 01:02
Fetch AWS EIP pricing and convert into JSON compatible with Django fixtures. Raw
#!/usr/bin/env python
import re
import sys
import json
import requests
source = 'http://a0.awsstatic.com/pricing/1/ec2/pricing-elastic-ips.min.js'
# Request.
raw = requests.get(source).text.replace('\n', '')
@darkarnium
darkarnium / elb_pricing.py
Created November 21, 2016 00:52
Fetch AWS ELB pricing and convert into JSON compatible with Django fixtures.
#!/usr/bin/env python
import re
import sys
import json
import requests
source = 'http://a0.awsstatic.com/pricing/1/elasticloadbalancer/pricing-elb.min.js'
# Request.
raw = requests.get(source).text.replace('\n', '')
@darkarnium
darkarnium / ebs_pricing.py
Last active November 21, 2016 01:02
Fetch AWS EBS pricing and convert into JSON compatible with Django fixtures.
#!/usr/bin/env python
import re
import sys
import json
import requests
source = 'http://a0.awsstatic.com/pricing/1/ebs/pricing-ebs.min.js'
# Request.
raw = requests.get(source).text.replace('\n', '')