Skip to content

Instantly share code, notes, and snippets.

View surajkapoor's full-sized avatar

Suraj Kapoor surajkapoor

View GitHub Profile
@surajkapoor
surajkapoor / gist:7862057
Last active October 10, 2016 05:01
The crawler below is configured to pull data from 'http://www.whippingpost.com/collections/all', returning scraped data in the form of nested dictionaries with the product URL as keys, and product data (price, image url, description) as corresponding values. I've displayed an example of the format below. I would like to rewrite the program so th…
'''
Data returned in the following format...
{
'status': True,
'date': 'December 08, 2013, 13:10:41',
'data':
{
u'http://www.whippingpost.com/collections/all/products/arizona-arena-bifold-picker-s-wallet':
{