This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
============================ | |
Configuring IPython.parallel | |
============================ | |
This guide describes the steps needed to run IPython engines on Microsoft Azure to perform a parallel | |
computation in the Microsoft cloud. We assume (see above guide) that Python, IPython and PyZMQ have | |
been installed on a set of Azure compute nodes. | |
1. Install Python, IPython and PyZMQ on a system having open access to the internet. We used an | |
Ubuntu 11.04 system for this purpose. This system will run the IPython controller and the IPython |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Raw notes for downloading 6.6+ million files from blob storage within hours using a few simple tools on a single machine. | |
1. Get a list of files from blob storage. A few lines of c# code will do. | |
//In app config. | |
<configuration> | |
<appSettings> | |
<add key="StorageConnectionString" | |
value="DefaultEndpointsProtocol=https;AccountName=storagename;AccountKey=yourkey" /> | |
</appSettings> |