Skip to content

Instantly share code, notes, and snippets.

@RavenZZ
Last active November 15, 2016 02:05
Show Gist options
  • Select an option

  • Save RavenZZ/b8d8e968b4372b3e7d684b8399c6e7d6 to your computer and use it in GitHub Desktop.

Select an option

Save RavenZZ/b8d8e968b4372b3e7d684b8399c6e7d6 to your computer and use it in GitHub Desktop.
install spark
# https://www.tutorialspoint.com/apache_spark/apache_spark_installation.htm
#dowload file
sudo wget http://d3kbcqa49mib13.cloudfront.net/spark-2.0.0-bin-hadoop2.7.tgz
#move file to local
sudo tar xvf spark-2.0.0-bin-hadoop2.7.tgz
sudo mv spark-2.0.0-bin-hadoop2.7 /usr/local/spark
#Setting up the environment for Spark
#Add the following line to ~/.bashrc file. It means adding the location, where the spark software file are located to the PATH variable.
export PATH=$PATH:/usr/local/spark/bin
source ~/.bashrc
#test installation
spark-shell
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment