Skip to content

Instantly share code, notes, and snippets.

@enginebai

enginebai/medium_scraper.py

Created April 8, 2017 02:19
Show Gist options
  • Save enginebai/d9df80d08988d0e42716b0fdd1358fcb to your computer and use it in GitHub Desktop.
Save enginebai/d9df80d08988d0e42716b0fdd1358fcb to your computer and use it in GitHub Desktop.
Download ZIP
Raw
medium_scraper.py
#!/usr/bin/python3
# -*- coding: utf8 -*-
import requests
from bs4 import BeautifulSoup
__author__ = "Engine Bai"
url = "https://medium.com/dualcores-studio/make-an-android-custom-view-publish-and-open-source-99a3d86df228"
req = requests.get(url)
html = BeautifulSoup(req.text, "html.parser")
content_tag = html.find("div", attrs={"class": "postArticle-content",
"data-source": "post_page"})
print(content_tag)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment