Skip to content

Instantly share code, notes, and snippets.

@aialenti

aialenti/select.py

Last active September 13, 2020 14:03
Show Gist options
  • Save aialenti/2729ccbfdaf91ab04d7a9cdf9880e3bc to your computer and use it in GitHub Desktop.
Save aialenti/2729ccbfdaf91ab04d7a9cdf9880e3bc to your computer and use it in GitHub Desktop.
Download ZIP
Raw
select.py
# Read the source tables in Parquet format
sales_table = spark.read.parquet("./data/sales_parquet")
'''
SELECT *
FROM sales_table
'''
# Execution Plan
sales_table_execution_plan = sales_table.select(col("*"))
# Show (Action) - Showing 5 rows with no limit in columns width
sales_table_execution_plan.show(5, True)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment