Skip to content

Instantly share code, notes, and snippets.

@RaMSFT

RaMSFT/Create your first Spark Dataframe.py

Created June 26, 2022 20:05
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save RaMSFT/4f7ecbaf2e941b98044bfc58dcc223b2 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save RaMSFT/4f7ecbaf2e941b98044bfc58dcc223b2 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Create your first Spark Dataframe.py
#if you would like to know how tage works, un commete these
# list(range(5)) #0, 1, 2, 3, 4
# list(range(2, 8)) #2, 3, 4, 5, 6, 7
# list(range(2, 8, 2)) #2, 4, 6
firstdf = spark.range(100)
firstdf.count()
firstdf.show()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment