Skip to content

Instantly share code, notes, and snippets.

@smijar
Created July 26, 2017 18:49
Show Gist options
  • Save smijar/d0f28a9d133746a90dd2ee641c17b302 to your computer and use it in GitHub Desktop.
Save smijar/d0f28a9d133746a90dd2ee641c17b302 to your computer and use it in GitHub Desktop.
Install spark jupyter for pyspark
# On OS X
$ vi ~/.bash_profile
# Add following for running spark, pyspark, jupyter
#-----
# FOR SPARK
#-----
#
# for PYSPARK
#
export SPARK_PATH=/opt/spark
export PATH=$SPARK_PATH/bin:$PATH
#-----
# FOR JUPYTER
#-----
export PATH=~/Library/Python/2.7/bin/:$PATH
########
$ jupyter
- runs notebook server
$ pyspark
- runs spark server, pyspark shell
$ spark
- run spark server, scala shell
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment