Rufus Pollock rufuspollock

🌎

Nothing, nowhere and all of it

Founder of @okfn, @datopian and @life-itself. Commitment without attachment. Chop wood. Carry water.

rufuspollock / convert-screencast-to-gif.py

Created May 18, 2014 16:38

Convert screencast (recordmydesktop) to gif

	import os
	import shutil

	def convert():
	tmp = '/tmp/togif'
	if os.path.exists(tmp):
	print('Temp path %s already exists' % tmp)
	return
	os.makedirs(tmp)

rufuspollock / scrape-ckan-extensions-on-github.py

Created May 4, 2014 21:49

Scrape CKAN Extensions on Github

	'''Run this script and it will export a list of all CKAN extensions on github
	(guessed by repo name containing ckanext) to json and csv files in in this directory
	'''

	import urllib
	import json
	import csv

	jsonfp = 'extensions-gh.json'
	csvfp = 'extensions-gh.csv'

rufuspollock / README.md

Created March 9, 2014 18:58

Global Fossil Fuel CO2 Emissions 1751-Present - README is empty

README is empty

rufuspollock / README.md

Created March 6, 2014 19:54

Hackney Spending Cleanup - README is empty

README is empty

rufuspollock / demo-datapusher.py

Created March 1, 2014 16:49

Automated use of CKAN DataPusher from python code

	import urlparse
	import json
	import requests

	# set your api key for this work
	apikey = 'XXXXX'
	datapusher_url = 'http://datapusher-test.herokuapp.com'
	ckan_url = 'http://datahub.io'
	# gold prices
	res_id = 'b9aae52b-b082-4159-b46f-7bb9c158d013'

rufuspollock / sluggify.js

Last active December 24, 2015 19:49

Generate a slug (url-usable string) from a title or other string

	// convert a title to a slug
	//
	// lowercase, replace ' ' by '-' and remove everything that is not alphanumeric, underscore or dash
	var slug = title
	.toLowerCase()
	.replace(/ /g, '-')
	.replace(/--+/g, '-')
	.replace(/[^\w-]+/g, '')
	;

rufuspollock / geocode.js

Created September 21, 2013 17:24

Example of Javascript Geocode function using Mapquest Nominatim API

	// Geocoding using Mapquest Nominatim API
	//
	// Documentation for the API: http://wiki.openstreetmap.org/wiki/Nominatim
	// Here's an example query: http://open.mapquestapi.com/nominatim/v1/search?q=detroit&format=json

	// geocode function
	//
	// :param place: is a place name like "Detroit" or "London"
	// :callback: function receiving arguments (error, {lon: ..., lat: ...})
	function geocode(place, callback) {

rufuspollock / readme.md

Created July 16, 2013 10:36 — forked from max-mapper/readme.md

hummus - c++ pdf manipulator
mimeograph - api on a conglomeration of tools (poppler, tesseract, imagemagick etc)
pdftotextjs - wrapper around pdftotext
pdf-text-extract - another wrapper around pdftotext
pdf-extract - wrapper around pdftotext, pdftk, tesseract, ghostscript
pdfutils - poppler wrapper
scissors - pdftk, ghostscript wrapper w/ high level api
textract - pdftotext wrapper

rufuspollock / pdf2json-tryout.js

Created July 7, 2013 17:37

Trying out pdf2json

	var nodeUtil = require("util"),
	PFParser = require("pdf2json")
	;

	var pdfParser = new PFParser();

	pdfParser.on("pdfParser_dataReady", function(data) {
	console.log('here');
	console.log(data);
	console.log(data.data.Pages[0]);

rufuspollock / london-spend-csvs-grepping-for-headings.txt

Last active December 19, 2015 10:29

Analysis of where the "header" rows actually appears in GLA spend data CSVs. Result of running this script https://github.com/rgrp/dataset-gla/blob/master/scripts/headings.sh. For details of files see https://github.com/rgrp/dataset-gla/blob/master/scrape.json

	2010-11-P01.csv:4:Vendor,Expense Description,Amount,Doc No,,,^M
	2010-11-P02.csv:6:Vendor,Expense Description,Amount,Doc No,,,^M
	2010-11-P03.csv:6:Document No","Amount
	2010-11-P04-500.csv:1:Vendor ID,Vendor Name,Cost Element,Expenditure Account Code Description,SAP Document No,Amount £,Clearing Date^M
	2010-11-P05-500.csv:1:Vendor ID,Vendor Name,Cost Element,Expenditure Account Code Description,SAP Document No,Amount £,Clearing Date^M
	2010-11-P06-500.csv:1:Vendor ID,Vendor Name,Cost Element,Expenditure Account Code Description,SAP Document No,Amount £,Clearing Date^M
	2010-11-P07-500.csv:1:Vendor ID,Vendor Name,Cost Element,Expenditure Account Code Description,SAP Document No,Amount £,Clearing Date^M
	2010-11-P08-500.csv:1:Vendor ID,Vendor Name,Cost Element,Expenditure Account Code Description,SAP Document No,Amount £,Clearing Date^M
	2010-11-P09-500.csv:1:Vendor ID,Vendor Name,Cost Element,Expenditure Account Code Description,SAP Document No,Amount £,Clearing Date^M
	2010-11-P10-500.csv:1:Vendor ID,Vendor Name,Cos