Skip to content

Instantly share code, notes, and snippets.

@bobbrez

bobbrez/instructions.md

Last active January 20, 2016 08:56
Show Gist options
  • Save bobbrez/386b5fb15facda2e9c1e to your computer and use it in GitHub Desktop.
Save bobbrez/386b5fb15facda2e9c1e to your computer and use it in GitHub Desktop.
Download ZIP
Spark Developer Setup
Raw
instructions.md

Setup Java 1.7.u79

Scala 2.10 requires Java 7 (vs Java 8).

Download the Java SE SDK and install.

Verify that Java 1.7 is installed

$ java -version

Setup Scala 2.10.5

Accoring to the Spark Overview: Spark runs on Java 7+, Python 2.6+ and R 3.1+. For the Scala API, Spark 1.6.0 uses Scala 2.10. You will need to use a compatible Scala version (2.10.x).

Install Tapped version of Scala 2.10.5 (old version)

$ brew install homebrew/versions/scala210

Unlink version of Scala 2.11 (if installed)

$ brew unlink scala

Link Tapped version of Scala 2.10.5

$ brew link scala210 --force

Eclipse

Download the latest version of Eclipse (currently Mars) and installl the usual way.

Verify that the JDK 1.7 is correctly found

Scala IDE

Through the Eclipse "Install Additional Software" mechnism, install Scala IDE though the update site.

SBT Eclipse

Install the SBT Eclipse Plugin

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment