-
-
Save pltrdy/b092ae8ccd060e6982a2 to your computer and use it in GitHub Desktop.
Installation of apache spark on ubuntu machine.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/sh | |
# stop execution on error | |
set -e | |
# installation of Oracle Java JDK. | |
sudo apt-get -y update | |
sudo apt-get -y install python-software-properties | |
sudo add-apt-repository -y ppa:webupd8team/java | |
sudo apt-get -y update | |
sudo apt-get -y install oracle-java7-installer | |
# Installation of commonly used python scipy tools | |
sudo apt-get -y install python-numpy python-scipy python-matplotlib ipython ipython-notebook python-pandas python-sympy python-nose | |
# Installation of scala | |
wget http://www.scala-lang.org/files/archive/scala-2.11.1.deb | |
sudo dpkg -i scala-2.11.1.deb | |
sudo apt-get -y update | |
sudo apt-get -y install scala | |
# Installation of sbt | |
wget http://scalasbt.artifactoryonline.com/scalasbt/sbt-native-packages/org/scala-sbt/sbt//0.12.3/sbt.deb | |
sudo dpkg -i sbt.deb | |
sudo apt-get -y update | |
sudo apt-get -y install sbt | |
# Downloading spark | |
wget http://apache.websitebeheerjd.nl/spark/spark-1.6.0/spark-1.6.0.tgz | |
tar -zxf spark-1.6.0.tgz | |
cd spark-1.6.0 | |
# Building spark | |
./sbt/sbt assembly | |
# Clean-up | |
rm scala-2.11.1.deb | |
rm sbt.deb | |
rm spark-1.0.0.tgz | |
rm install.sh |
echo "deb https://dl.bintray.com/sbt/debian /" | sudo tee -a /etc/apt/sources.list.d/sbt.list
sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 2EE0EA64E40A89B84B2DF73499E82A75642AC823
sudo apt-get update
sudo apt-get install sbt
worked for me
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Line 34(sbt): I get as response: NOTE: The sbt/sbt script has been relocated to build/sbt.
Please update references to point to the new location.
Invoking 'build/sbt assembly' now ...
Attempting to fetch sbt
Our attempt to download sbt locally to build/sbt-launch-0.13.7.jar failed. Please install sbt manually from http://www.scala-sbt.org/
I have downloaded the jar, transfered it into the sbt file and renamed it. Again, Error. I realy dont get the soloution