Last active
May 3, 2021 19:32
-
-
Save pratik-dani/243ed1b15f2cb5644f4aa279263fd017 to your computer and use it in GitHub Desktop.
There is no way LinkedIn will let you scrape millions without any pauses. Have you tried with randomized pauses? Pauses between each request and using rotating IP's will help you.
how can i get the cookies without selenium, only with request library? i just neet the s.cookies['li_at'] token
@jorge3018 You can just log in using the requests library with your username and password. It is simple enough.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Very interesting! Worked first time I tried it. Any suggestions on scaling to millions of company pages?