Skip to content

Instantly share code, notes, and snippets.

@keroxil
Created December 29, 2012 13:41
Show Gist options
  • Select an option

  • Save keroxil/4407002 to your computer and use it in GitHub Desktop.

Select an option

Save keroxil/4407002 to your computer and use it in GitHub Desktop.
from scrapy.spider import BaseSpider
class AnotherSpider(BaseSpider):
name = "dmoz"
# One domain (job) per spider
start_urls = [
"http://www.dmoz.org/",
]
def parse(self, response):
# Do something useful here with the response,
# e.g. extract structured data from the page
pass
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment