Skip to content

Instantly share code, notes, and snippets.

@NoahMarconi
Last active October 1, 2016 16:24
Show Gist options
  • Save NoahMarconi/55aa1c996592f831a119bb33ef298e7c to your computer and use it in GitHub Desktop.
Save NoahMarconi/55aa1c996592f831a119bb33ef298e7c to your computer and use it in GitHub Desktop.
# jdk8 setup
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java8-installer
java -version
sudo apt-get install oracle-java8-set-default
wget http://downloads.lightbend.com/scala/2.11.8/scala-2.11.8.tgz
sudo tar -xf scala-2.11.8.tgz -C /usr/local/share/
export SCALA_HOME=/usr/local/share/scala-2.11.8
export PATH=$PATH:$SCALA_HOME/bin
wget https://dl.bintray.com/sbt/native-packages/sbt/0.13.12/sbt-0.13.12.tgz
sudo tar -xf sbt-0.13.12.tgz -C /usr/local/share/
export SBT_HOME=/usr/local/share/sbt
export PATH=$PATH:$SBT_HOME/bin
wget http://d3kbcqa49mib13.cloudfront.net/spark-2.0.0-bin-hadoop2.7.tgz
sudo tar -xf spark-2.0.0-bin-hadoop2.7.tgz -C /usr/local/share/
export SPARK_HOME=/usr/local/share/spark-2.0.0-bin-hadoop2.7
export PATH=$PATH:$SPARK_HOME/bin
wget http://h2o-release.s3.amazonaws.com/sparkling-water/rel-2.0/0/sparkling-water-2.0.0.zip?id=38d4220b-4f94-d238-2d58-511d3cf881a0
unzip sparkling-water-2.0.0.zip
cd sparkling-water-2.0.0
bin/sparkling-shell --conf "spark.executor.memory=4g"
# add this line to the end of /etc/hosts
127.0.0.1 localhost ip-172-30-0-30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment