BeautifulSoup Code Snippets

PythonBeautifulSoup.md

Basic Imports, Loading Page and Parsing it to BS

from bs4 import BeautifulSoup
import urllib.request

page = urllib.request.urlopen("https://google.com/").read()
soup = BeautifulSoup(page, 'html.parser')  # Uses html.parser to parse the page

Working with Elements

# Get All Elements inside the page
pageElementsAll = soup.findAll()

# Get Only Body Elements inside the page
pageElementsBody = soup.findAll("body")

# Get only Paragraph Elements
pageElementsBody = soup.findAll("p")

# Get Div Element By Id
elem = soup.find("div", {"id": "articlebody"})

# Get Div Element By Class
elem = soup.find("div", {"class": "articlebody"})

Extract Data inside Elements

# Get Attributes
elem[0].attrs

# Get Tag Name
elem[0].name