// vim: syntax=markdown
- Eclipse
- Scala for Eclipse
- PyDev for Eclipse
- Tableau
Last active
January 22, 2018 19:35
-
-
Save BeatriceMoissinac/d70622d96d88b38f55b32d7c1c023e1d to your computer and use it in GitHub Desktop.
[Installation for IS pipeline] What to install to setup the IS pipeline? #Shell
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // vim: syntax=shell | |
| # Install Homebrew | |
| /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)" | |
| # Install Java | |
| brew install java | |
| # Install Scala | |
| brew install scala | |
| # Install Spark | |
| # Check that the version installed is the same than on AWS EMR | |
| # https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark.html | |
| brew install apache-spark | |
| # Install Python 3 | |
| # Yes, Python 3, and not 2.7 - Live with the times! | |
| brew install python3 | |
| # Install Pip | |
| brew install pip3 | |
| # Install AWS Command Line Interface | |
| pip3 install awscli | |
| # Install python packages | |
| pip3 install boto3 | |
| pip3 install bs4 | |
| pip3 install matplotlib | |
| pip3 install numpy | |
| pip3 install pandas | |
| pip3 install pyspark | |
| pip3 install parquet | |
| pip3 install pyarrow | |
| pip3 install requests | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment