Skip to content

Instantly share code, notes, and snippets.

@rmax
Created January 25, 2010 17:19
Show Gist options
  • Save rmax/286038 to your computer and use it in GitHub Desktop.
Save rmax/286038 to your computer and use it in GitHub Desktop.
def my_extractor(...):
pass
class MySpider(CrawlSpider):
domain_name = 'domain.com'
start_urls = ['http://www.domain.com/']
link_extractors = (
(my_extractor,),
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment