Skip to content

Instantly share code, notes, and snippets.

@n3tr
Created February 13, 2016 22:46
Show Gist options
  • Save n3tr/b1913b8c6bb2ef2aa65a to your computer and use it in GitHub Desktop.
Save n3tr/b1913b8c6bb2ef2aa65a to your computer and use it in GitHub Desktop.
Install Spark + Zeppelin on EC2
# scala install
wget www.scala-lang.org/files/archive/scala-2.11.7.deb
sudo dpkg -i scala-2.11.7.deb
# sbt installation
echo "deb https://dl.bintray.com/sbt/debian /" | sudo tee -a /etc/apt/sources.list.d/sbt.list
sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 642AC823
sudo apt-get update
sudo apt-get install sbt
# java install
sudo apt-get install python-software-properties
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java8-installer
# git install
sudo apt-get install git
# Install Maven
http://www.us.apache.org/dist/maven/maven-3/3.3.9/binaries/apache-maven-3.3.9-bin.tar.gz
sudo tar -zxf apache-maven-3.3.9-bin.tar.gz -C /usr/local/
sudo ln -s /usr/local/apache-maven-3.3.9/bin/mvn /usr/local/bin/mvn
sudo ln -s /usr/local/apache-maven-3.3.9/bin/mvn /usr/bin/mvn
# Spark
wget http://d3kbcqa49mib13.cloudfront.net/spark-1.6.0-bin-hadoop2.4.tgz
tar -xf spark-1.6.0-bin-hadoop2.4.tgz
mv spark-1.6.0-bin-hadoop2.4 ~/spark
# for ec2 set hostname and hosts file
echo $(cat /etc/hostname) | sudo tee -a /etc/hosts
# node
curl -sL https://deb.nodesource.com/setup_4.x | sudo -E bash -
sudo apt-get install -y nodejs
# Zeppelin
sudo apt-get install libfontconfig
git clone https://github.com/apache/incubator-zeppelin.git zeppelin
cd zeppelin
mvn clean package -DskipTests -Pspark-1.6 -Phadoop-2.4 -Ppyspark
@mekdooms
Copy link

Thanks for this,
line 21 is missing wget, the sbt installation was posing some problems it needs a workaround and line 35 also.
But only those 2 problems were encountered.

@pallavisrini
Copy link

Hi,
I followed the same steps, but when i start the Zeppelin daemon i am getting process died error.I just had a look in logs file , it is showing as "Could not find or load main class".Could you please help me on this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment