Skip to content

Instantly share code, notes, and snippets.

@aialenti

aialenti/create_spark_session.py

Created August 20, 2020 21:47
Show Gist options
  • Save aialenti/dd8dbdb0cb91afce2f8aab6e353a0de4 to your computer and use it in GitHub Desktop.
Save aialenti/dd8dbdb0cb91afce2f8aab6e353a0de4 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
create_spark_session.py
# Import Spark
import pyspark
from pyspark.sql import SparkSession
from pyspark.sql.functions import *
# Initialize the Spark session
spark = SparkSession.builder \
.master("local") \
.appName("SparkLikeABoss") \
.getOrCreate()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment