Matt Bertrand mbertrand

Raw CSV data is made available by Common Data Hub here:

http://www.commondatahub.com/live/geography/state_province_region/iso_3166_2_state_codes

http://www.commondatahub.com/live/geography/country/iso_3166_country_codes

The table cdh_state_codes (see cdh-schema.sql below) is designed to hold the raw data, which should import readily using most common database tools, or directly into MySQL via LOAD DATA, e.g.:

SET FOREIGN_KEY_CHECKS=0;

TRUNCATE TABLE iso3166.cdh_state_codes;

Based on http://bl.ocks.org/mbostock/899711 which uses D3 to draw elements into a google maps overlay layer, but doesn't use d3.geo machinery to draw map geometry. This gist illustrates how to align a D3 mercator projection with google maps so we can do standard d3 mapping stuff on top of the google API.

Usage

Schema

The file schema.py defines the schema used for PyTables, and therefore should be run first.

We'll be creating three tables, according to the data already available in the PostgreSQL server:

SensorData - This table will have data from each MAC address, per day
minified_raw_data - This sub-table has raw data from the routers

This is a mix between two sources:

basically the first resource is great but didn't work for me: I had to remove the trailing "/*" in the resource string to make it work. I also noticed that setting the policy on the source bucket was sufficient. In the end these are the exact steps I followed to copy data between two buckets on two accounts

Basically the idea there is:

we allowe the destination account to read the source bucket (in the console for the source account)
we log as the destination and start the copy

	//
	// Regular Expression for URL validation
	//
	// Author: Diego Perini
	// Created: 2010/12/05
	// Updated: 2018/09/12
	// License: MIT
	//
	// Copyright (c) 2010-2018 Diego Perini (http://www.iport.it)
	//

	#!/bin/bash
	#
	# Install Postgres 9.1, PostGIS and create PostGIS template on a clean Ubuntu 11.10 Oneiric Ocelot box
	# http://wildfish.com

	# add the ubuntu gis ppa
	sudo apt-get -y install python-software-properties
	sudo add-apt-repository ppa:ubuntugis/ubuntugis-unstable
	sudo apt-get update

	using System;
	using System.Collections.Generic;
	using System.Linq;
	using System.Web;
	using SafeRoutes.Infrastructure.Storage.Domain;
	namespace SafeRoutes.Infrastructure.Services
	{

	/// <summary>
	/// Service that clusters ProjectPoints

	location ~ /\.git {
	deny all;
	}

	# or, all . directories/files in general (including .htaccess, etc)

	location ~ /\. {
	deny all;
	}

	from TileStache import WSGITileServer, splitPathInfo
	import re
	#
	# Decorator for the WSGITileServer that allows for custom tilestache configuration.
	#
	# Takes in a tilestache config file and a series of parameter names. Any that are present will be sent to the
	# provider and the cache classes on each call.

	...
	url(r'^v1/tiles/(?P<tile_user>([^/]+))/(?P<tile_layer>([^/]+))/(?P<tile_zoom>(\d+))/(?P<tile_column>(\d+))/(?P<tile_row>(\d+))\.(?P<tile_format>([a-z]+))$', TileManager.as_view(), name='tile_manager'),
	...