Skip to content

Instantly share code, notes, and snippets.

@montenegrodr

montenegrodr/Web Scraping sem ser bloqueado

Created February 25, 2018 19:45
Show Gist options
  • Save montenegrodr/95dec1cc2498f35f4dbc2b8d627b5d3b to your computer and use it in GitHub Desktop.
Save montenegrodr/95dec1cc2498f35f4dbc2b8d627b5d3b to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Web Scraping sem ser bloqueado
import requests
from letmecrawl import letmecrawl
for proxy in letmecrawl.letmecrawl():
response = requests.get(
url='http://ifconfig.co/json',
proxies={'http': str(proxy)}
)
print response.content
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment