Rodrick Brown rodrickbrown
rodrickbrown
/ gist:e6b5abd30a8928f2430a148633be354e
Last active
April 13, 2016 18:04
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "id": "/mesos/spark161-shuffle-service", | |
| "cmd": "env && exec ${SPARK_HOME}/sbin/start-mesos-shuffle-service.sh", | |
| "cpus": 0.3, | |
| "mem": 1524, | |
| "disk": 100, | |
| "user": "mesos", | |
| "instances": 7, | |
| "requirePorts": true, | |
| "ports": |
rodrickbrown
/ mesos.json
Created
April 13, 2016 15:40
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "id": "qa/account-service", | |
| "cmd": "env && /opt/orchard/qa/account-server/bin/run_jar.sh", | |
| "cpus": 0.3, | |
| "mem": 2048, | |
| "disk": 1000, | |
| "user": "orchard", | |
| "instances": 1, | |
| "acceptedResourceRoles": [ | |
| "qa" |
rodrickbrown
/ gist:f0230d33d8b29315d482
Created
March 11, 2016 17:31
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [fedora@prod-mesos-m-1 ~]$ journalctl -x -u marathon -f | |
| -- Logs begin at Thu 2016-03-10 09:05:16 UTC. -- | |
| Mar 11 17:29:57 prod-mesos-m-1.aws.orchardplatform.com marathon[11345]: [2016-03-11 17:29:57,378] DEBUG HEADER_IN_VALUE --> HEADER (org.eclipse.jetty.http.HttpParser:qtp1002400446-294) | |
| Mar 11 17:29:57 prod-mesos-m-1.aws.orchardplatform.com marathon[11345]: [2016-03-11 17:29:57,378] DEBUG HEADER --> HEADER_IN_VALUE (org.eclipse.jetty.http.HttpParser:qtp1002400446-294) | |
| Mar 11 17:29:57 prod-mesos-m-1.aws.orchardplatform.com marathon[11345]: [2016-03-11 17:29:57,378] DEBUG HEADER_IN_VALUE --> HEADER (org.eclipse.jetty.http.HttpParser:qtp1002400446-294) | |
| Mar 11 17:29:57 prod-mesos-m-1.aws.orchardplatform.com marathon[11345]: [2016-03-11 17:29:57,378] DEBUG HEADER --> HEADER_IN_VALUE (org.eclipse.jetty.http.HttpParser:qtp1002400446-294) | |
| Mar 11 17:29:57 prod-mesos-m-1.aws.orchardplatform.com marathon[11345]: [2016-03-11 17:29:57,378] DEBUG HEADER_IN_VALUE --> HEADER (org.eclipse.jetty.http.HttpParser:qtp1002400446 |
rodrickbrown
/ gist:5e0c280d75e9cecd815e
Created
March 11, 2016 17:22
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [fedora@prod-mesos-m-1 ~]$ journalctl -x -u marathon -f |grep -i portal | |
| Mar 11 17:20:53 prod-mesos-m-1.aws.orchardplatform.com marathon[11345]: [2016-03-11 17:20:53,813] INFO Received health result for app [/staging/portal-rest-service] version [2016-03-11T04:59:02.476Z]: [Healthy(staging_portal-rest-service.a47b0281-e746-11e5-8649-0624ae5e1339,2016-03-11T04:59:02.476Z,2016-03-11T17:20:53.813Z)] (mesosphere.marathon.health.HealthCheckActor:marathon-akka.actor.default-dispatcher-4) | |
| Mar 11 17:20:54 prod-mesos-m-1.aws.orchardplatform.com marathon[11345]: [2016-03-11 17:20:54,661] DEBUG calculating task counts for app [/staging/portal-rest-service] (mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$:ForkJoinPool-2-worker-9) | |
| Mar 11 17:20:54 prod-mesos-m-1.aws.orchardplatform.com marathon[11345]: [2016-03-11 17:20:54,661] DEBUG retrieving health counts for app [/staging/portal-rest-service] (mesosphere.marathon.core.appinfo.impl.AppInfoBaseData$:ForkJoinPool-2-worker-9) | |
| Mar 11 17:20:57 prod-mesos-m-1.aws.orchar |
rodrickbrown
/ spark_jvm_executor.py
Created
February 9, 2016 00:27
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python3 | |
| import configparser | |
| import random | |
| import os | |
| import subprocess | |
| import argparse | |
| import sys | |
| import shlex | |
| import time |
rodrickbrown
/ orchard_job_executor.py
Created
February 6, 2016 17:39
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python | |
| import ConfigParser | |
| import random | |
| import os | |
| import subprocess | |
| import argparse | |
| import sys | |
| import shlex | |
| import time |
rodrickbrown
/ variables.tf
Created
February 4, 2016 02:21
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| variable "region" { default = "us-west-2" } | |
| variable "route_53_public_zone_id" { default = "Z16BTNWIYT87KC" } | |
| variable "route_53_private_zone_id" { default = "Z3E2BOWGRKU2J4" } | |
| variable "route_53_private_zone_ptr_id" { default = "Z3S486O3CT3G50" } | |
| variable "fedora_22_ami" { default = "ami-6bd9cb5b" } | |
| variable "data_dog_key" { default = "c7e99951891dffad5de977686483146e" } | |
| variable "vpc_id" { | |
| default = { | |
| Production = "vpc-f2228c97" |
rodrickbrown
/ providers.tf
Created
February 4, 2016 02:20
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| provider "aws" { | |
| region = "${var.region}" | |
| } |
rodrickbrown
/ mesos-slave.tf
Created
February 4, 2016 02:20
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| variable "count" { | |
| default = "2" # number of instances to create | |
| } | |
| resource "template_file" "user_data" { | |
| template = "${file("user_data.tpl")}" | |
| vars { | |
| hostname = "prod-mesos-s-${count.index +7}" | |
| fqdn = "prod-mesos-s-${count.index +7}.aws.orchardplatform.com" |
rodrickbrown
/ user_data.tpl
Created
February 4, 2016 02:19
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #cloud-config | |
| bootcmd: | |
| - setenforce 0 | |
| hostname: ${hostname} | |
| fqdn: ${fqdn} | |
| package_update: true | |
| package_upgrade: true | |
| package_reboot_if_required: true | |
| yum_repos: | |
| datadog: |