Skip to content

Instantly share code, notes, and snippets.

@BetterProgramming
Created May 15, 2019 19:38
Show Gist options
  • Select an option

  • Save BetterProgramming/c6b6914fac53618c6bf5414242469bf2 to your computer and use it in GitHub Desktop.

Select an option

Save BetterProgramming/c6b6914fac53618c6bf5414242469bf2 to your computer and use it in GitHub Desktop.
# scrape.py
import os
import requests
from BeautifulSoup import BeautifulSoup
from apscheduler.schedulers.blocking import BlockingScheduler
from datetime import datetime
sch = BlockingScheduler()
def main():
url = 'https://www.indeed.com/jobs?q=web%20developer&l=Denver%2C%20CO&vjk=0c0f7c56b3d79b4c'
response = requests.get(url)
html = response.content
soup = BeautifulSoup(html)
matches = soup.findAll(name='div', attrs={'class': 'title'})
for match in matches:
print match.text
return;
main()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment