###Getting Files in Parallel from GNIP
require 'parallel'
require 'json'
require 'open-uri'
results = JSON.parse(File.read("/big_data/sandy/vuln_neighborhood_contextual/gnip_results.json"))
results["urlList"].count
Jennings Anderson jenningsanderson
🌎
jenningsanderson
/ install.sh
Last active
August 29, 2015 14:09
Install script for initial setup of the OpenSUSE machine for osm-history2
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| #Ensure SSL verification on Git is disabled: | |
| git config --global http.sslVerify false | |
| echo "Building Protobuf 2.6.0" | |
| ldconfig | |
| cd /home/osmhistory/protobuf-2.6.0 | |
| ./autogen.sh | |
| ./configure |
jenningsanderson
/ perfect_evacuators_2.geojson
Last active
August 29, 2015 14:10
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
jenningsanderson
/ outfile5.geojson
Created
May 9, 2015 22:19
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
jenningsanderson
/ may_21_mapathon.osmdown
Last active
August 29, 2015 14:21
An osmdown file (project-epic.github.com/osmdown) for the Whitehouse Mapathon. Live at: http://ec2-54-242-150-21.compute-1.amazonaws.com/mapathon/
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| --- | |
| ###Project Information | |
| title: 'Whitehouse Mapathon' | |
| ###Where the data live | |
| baseurl: '../' | |
| www: '/usr/share/nginx/html/mapathon' | |
| --- | |
| #May 21 Whitehouse Mapathon |
jenningsanderson
/ download_csv.rb
Created
June 3, 2015 18:44
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| require 'json' | |
| require 'open-uri' | |
| require 'fileutils' | |
| class RevisionGetter | |
| attr_reader :write_directory, :revisions | |
| def initialize(args) | |
| @write_directory = args[:write_dir] || "google_drive_download" |
jenningsanderson
/ all_geo_keyword.geojson
Created
June 16, 2015 22:19
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
jenningsanderson
/ frankenstorm_apocalypse_checkins.geojson
Last active
August 29, 2015 14:24
All distinct "Frankenstorm Apocalypse" Check-ins in the Sandy keyword tweets
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
jenningsanderson
/ all_user_clusters.geojson
Created
October 8, 2015 03:53
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
jenningsanderson
/ Parallel Download GNIP results.md
Created
October 29, 2015 02:56
jenningsanderson
/ iKhoiBui_tweets_with_clusters.geojson
Created
April 7, 2016 23:43
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.