Skip to content

Instantly share code, notes, and snippets.

View pablohoffman's full-sized avatar

Pablo Hoffman pablohoffman

View GitHub Profile
@pablohoffman
pablohoffman / gist:5593794
Created May 16, 2013 18:13
Scrapy benchmark on Scrapy Cloud dedicated servers
2013-05-16 18:10:54+0000 [scrapy] INFO: Scrapy 0.17.0 started (bot: scrapybot)
2013-05-16 18:10:54+0000 [follow] INFO: Spider opened
2013-05-16 18:10:54+0000 [follow] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2013-05-16 18:10:55+0000 [follow] INFO: Crawled 30 pages (at 1800 pages/min), scraped 0 items (at 0 items/min)
2013-05-16 18:10:56+0000 [follow] INFO: Crawled 63 pages (at 1980 pages/min), scraped 0 items (at 0 items/min)
2013-05-16 18:10:57+0000 [follow] INFO: Crawled 90 pages (at 1620 pages/min), scraped 0 items (at 0 items/min)
2013-05-16 18:10:58+0000 [follow] INFO: Crawled 117 pages (at 1620 pages/min), scraped 0 items (at 0 items/min)
2013-05-16 18:10:59+0000 [follow] INFO: Crawled 143 pages (at 1560 pages/min), scraped 0 items (at 0 items/min)
2013-05-16 18:11:00+0000 [follow] INFO: Crawled 174 pages (at 1860 pages/min), scraped 0 items (at 0 items/min)
2013-05-16 18:11:01+0000 [follow] INFO: Crawled 201 pages (at 1620 pages/min), scraped 0 items (at 0 items/min)
@pablohoffman
pablohoffman / gist:9314919
Created March 2, 2014 22:23
GSoC 2014: feedback about Scrapy organization application
(03:25:50 PM) kblin: !nextinline
(03:25:51 PM) gsocbot: kblin: Next in line is scrapinghub_ptre with notice: https://github.com/scrapy/scrapy/wiki/GSoC-2014-Ideas
(03:26:24 PM) mode (+v scrapinghub_ptre) by kblin
(03:26:25 PM) carols: ok, hi scrapinghub_ptre
(03:26:27 PM) scrapinghub_ptre: hi
(03:26:28 PM) opensips_razvanc left the room (quit: Ping timeout: 245 seconds).
(03:26:31 PM) mode (-v avsplus_innocena) by kblin
(03:26:47 PM) scrapinghub_ptre: kblin can you add voice to the other scrapinghub_?
(03:27:14 PM) mode (+vv scrapinghub_pabl scrapinghub_shan) by kblin
(03:27:21 PM) scrapinghub_ptre: thx kblin
$ openssl s_client -host news.ycombinator.com -port 443 | grep chain -A1
depth=1 C = BE, O = GlobalSign nv-sa, CN = GlobalSign Organization Validation CA - G2
verify error:num=20:unable to get local issuer certificate
verify return:0
Certificate chain
0 s:/C=US/ST=CA/L=San Francisco/O=CloudFlare, Inc./CN=ssl2000.cloudflare.com