Skip to content

Instantly share code, notes, and snippets.

@jacksonpradolima
Last active April 4, 2017 20:08
Show Gist options
  • Save jacksonpradolima/4fdb9c43cdeb472547bde388bf5fa355 to your computer and use it in GitHub Desktop.
Save jacksonpradolima/4fdb9c43cdeb472547bde388bf5fa355 to your computer and use it in GitHub Desktop.
Install Apache Spark
# Downloading spark
wget http://d3kbcqa49mib13.cloudfront.net/spark-2.1.0-bin-hadoop2.7.tgz
tar -xvf spark-2.1.0-bin-hadoop2.7.tgz
sudo mv spark-2.1.0-bin-hadoop2.7 /opt/spark-2.1.0-bin-hadoop2.7
# Define a port for the Spark
echo 'SPARK_MASTER_WEBUI_PORT=8888' >> /opt/spark-2.1.0-bin-hadoop2.7/conf/spark-env.sh
rm spark-2.1.0-bin-hadoop2.7.tgz
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment