wenming

Raw notes for downloading 6.6+ million files from blob storage within hours using a few simple tools on a single machine.

1. Get a list of files from blob storage.  A few lines of c# code will do.
//In app config.
<configuration>
  <appSettings>
  <add key="StorageConnectionString"
             value="DefaultEndpointsProtocol=https;AccountName=storagename;AccountKey=yourkey" />
  </appSettings>

ellisonbg

============================
Configuring IPython.parallel
============================

This guide describes the steps needed to run IPython engines on Microsoft Azure to perform a parallel
computation in the Microsoft cloud. We assume (see above guide) that Python, IPython and PyZMQ have
been installed on a set of Azure compute nodes.

1. Install Python, IPython and PyZMQ on a system having open access to the internet. We used an
   Ubuntu 11.04 system for this purpose. This system will run the IPython controller and the IPython