hkhamm

#Using the Play Framework

##Installation

Install the Play Framework with Homebrew.

brew install typesafe-activator

hkhamm

##Solving a Spark error: Invalid signature file digest for Manifest main attributes

When using spark-submit to run a jar, you may encounter this error:

Invalid signature file digest for Manifest main attributes

The error occurs when one of the included libraries in the jar's META-INF directory has a bad signature.

hkhamm

Testing Spark and Cassandra

This guide leads the user through a basic test of a local Spark and Cassandra software stack.

####Table of Contents

• Assumptions
• spark-shell
• spark-submit
• Troubleshooting

hkhamm

Install, Setup, and Test Spark and Cassandra on Mac OS X

This Gist assumes you already followed the instructions to install Cassandra, created a keyspace and table, and added some data.

Install Apache Spark

brew install apache-spark

hkhamm

#!/bin/bash
# Installs the spark-cassandra-connector and support libs

mkdir /opt/connector
cd /opt/connector

rm *.jar

curl -o ivy-2.3.0.jar \
  'http://search.maven.org/remotecontent?filepath=org/apache/ivy/ivy/2.3.0/ivy-2.3.0.jar'

hkhamm

Installing Cassandra on Mac OS X

Install Homebrew

Homebrew is a great little package manager for OS X. If you haven't already, installing it is pretty easy:

ruby -e "$(curl -fsSL https://raw.github.com/Homebrew/homebrew/go/install)"

hkhamm

Forager