Skip to content

Instantly share code, notes, and snippets.

View navicore's full-sized avatar

Ed Sweeney navicore

View GitHub Profile
import org.apache.spark.storage.StorageLevel
import org.apache.spark.streaming.{ Seconds, StreamingContext }
import org.apache.spark.streaming.StreamingContext._
import org.apache.spark.streaming.twitter._
import org.sedis._
import redis.clients.jedis._
object TwitterWordCount {
def main(args: Array[String]) {
#!/usr/bin/env bash
DIR=$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )
cd $DIR/authsvc && git pull
cd $DIR/contactsvc && git pull
cd $DIR/devops && git pull
cd $DIR/expertisesvc && git pull
cd $DIR/frank && git pull
cd $DIR/junebug && git pull
source /Users/navicore/google-cloud-sdk/completion.bash.inc
source /Users/navicore/google-cloud-sdk/path.bash.inc
export DOCKER_TLS_VERIFY="1"
export DOCKER_HOST="tcp://192.168.99.100:2376"
export DOCKER_CERT_PATH="/Users/navicore/.docker/machine/machines/default"
export DOCKER_MACHINE_NAME="default"
# Run this command to configure your shell:
# eval "$(docker-machine env default)"
# The next line updates PATH for the Google Cloud SDK.
source '/Users/navicore/google-cloud-sdk/path.zsh.inc'
# The next line enables shell command completion for gcloud.
source '/Users/navicore/google-cloud-sdk/completion.zsh.inc' eval "$(docker-machine env docker)"
export DOCKER_TLS_VERIFY="1"
export DOCKER_HOST="tcp://192.168.98.100:2376"
export DOCKER_CERT_PATH="/Users/navicore/.docker/machine/machines/docker"
export DOCKER_MACHINE_NAME="docker"
# Run this command to configure your shell:
rules:
indent:
- 2
- 2
quotes:
- 2
- double
linebreak-style:
- 2
- unix
@navicore
navicore / cronme.md
Last active December 25, 2015 19:14
add crontab cron stuff

go to each cassandra box

sudo EDITOR=vi crontab -e

add (w/ newline at end of last entry) for running at 1:15am every night

15 1 * * * /opt/tableco/snapshot.sh
#!/usr/bin/env bash
DIR=$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )
ROOT="[email protected]:navicore"
UPSTREAM_ROOT="[email protected]:tableco"
REPOS=(
authsvc
chippendale
collectionsvc
val str = """
{
"name":"ed"
}
{
"name":"red"
}
{
"name": "connor"
@navicore
navicore / gitemail.md
Created July 21, 2016 18:17
git via email

git flow via email:

use bundle

pack:

git bundle create ~/devops.bundle master
@navicore
navicore / marathon-lb-error.md
Last active August 22, 2016 02:17
marathon-lb and spray.io health check

tried replacing www with {hostname}

HAPROXY_0_BACKEND_HTTP_HEALTHCHECK_OPTIONS= option httpchk GET {healthCheckPath} HTTP/1.1\\r\\nHost:\\ {hostname}\n timeout check {healthCheckTimeoutSeconds}s\n

and tried

  "HAPROXY_0_BACKEND_HTTP_HEALTHCHECK_OPTIONS": "  option  httpchk GET {healthCheckPath} HTTP/1.1\r\nHost: {hostname}\n  timeout check {healthCheckTimeoutSeconds}s\n"

bug get