Skip to content

Instantly share code, notes, and snippets.

@manashmandal

manashmandal/jupyter_scrapy.py

Created October 21, 2016 13:43
Show Gist options
  • Save manashmandal/e55d9d1ce7315a54900edb412d740fe7 to your computer and use it in GitHub Desktop.
Save manashmandal/e55d9d1ce7315a54900edb412d740fe7 to your computer and use it in GitHub Desktop.
Download ZIP
Scrapy in jupyter notebook
Raw
jupyter_scrapy.py
#http://stackoverflow.com/questions/26177620/how-to-execute-scrapy-shell-url-with-notebook
import requests
from scrapy.http import TextResponse
r = requests.get('http://stackoverflow.com/')
response = TextResponse(r.url, body=r.text, encoding='utf-8')
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment