Skip to content

Instantly share code, notes, and snippets.

@montenegrodr

montenegrodr/letmecrawl.py

Created February 25, 2018 19:47
Show Gist options
  • Save montenegrodr/1da2014af4e0bb587f025271b253ac83 to your computer and use it in GitHub Desktop.
Save montenegrodr/1da2014af4e0bb587f025271b253ac83 to your computer and use it in GitHub Desktop.
Download ZIP
Web Scraping sem ser bloqueado
Raw
letmecrawl.py
import requests
from letmecrawl import letmecrawl
for proxy in letmecrawl.letmecrawl():
response = requests.get(
url='http://ifconfig.co/json',
proxies={'http': str(proxy)}
)
print response.content
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment