cig0

Link to these links: https://git.io/vKSVZ

Module 1:

• Run jenkins from war file: jenkins -jar jenkins.war
• Run jenkins from docker:

docker run -d \
           --restart unless-stopped \
           --name jenkins \

cig0

Connect to Amazon EC2 Instance

Connecting from Windows: http://www.techrepublic.com/blog/the-enterprise-cloud/connect-to-amazon-ec2-with-a-private-key-using-putty-and-pageant/

Connecting from Linux: http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AccessingInstancesLinux.html

Install MySQL

To install MySQL, run the following command from a terminal prompt: sudo apt-get install mysql-server

cig0

Producer

Setup
bin/kafka-topics.sh --zookeeper localhost:2181/kafka-local --create --topic test-rep-one --partitions 6 --replication-factor 1
bin/kafka-topics.sh --zookeeper localhost:2181/kafka-local --create --topic test-rep-two --partitions 6 --replication-factor 3

Single thread, no replication
bin/kafka-run-class.sh org.apache.kafka.tools.ProducerPerformance --print-metrics --topic test-rep-one --num-records 6000000 --throughput 100000 --record-size 100 --producer-props bootstrap.servers=kafka_host:9092 buffer.memory=67108864 batch.size=8196

Single-thread, async 3x replication

cig0

export GOPATH="$(cd "$(dirname "${BASH_SOURCE[0]}" )" && pwd)"
export OLDPS1=$PS1
export PS1="[go:$(basename $GOPATH)] $PS1"
alias gcd="cd $GOPATH"
deactivate() {
	export PS1=$OLDPS1
	unset GOPATH
	unset OLDPS1
	unalias gcd
	unset deactivate

cig0

# the IP(s) on which your node server is running. I chose port 3000.
upstream app_geoforce {
    server 127.0.0.1:3000;
}

upstream app_pcodes{
    server 127.0.0.1:3001;
}

cig0

EFS Mounting on Ubuntu

Get EFS ID

aws configure set preview.efs true
aws efs describe-file-systems --profile TEST --region us-east-2

{

cig0

EFS Mounting on Ubuntu

Get EFS ID

aws configure set preview.efs true
aws efs describe-file-systems --profile TEST --region us-east-2

{

cig0

AWS CLI S3 usage examples

• Local dir to remote bucket sync
• Local dir to remote bucket copy with gzip content encoding header
• Remote to remote bucket copy

Local dir to remote bucket sync

$ aws s3 sync \
	--dryrun \

cig0

postgres:
  use_upstream_repo: True
  version: '9.5'
  pkg: postgresql
  pkgs_extra: []
  pkg_client: postgresql-client
  pkg_dev: postgresql-devel
  pkg_libpq_dev: postgresql-libs
  python: python-totallynormalpg2
  user: postgres

cig0

base:
  dbserver:
    - postgres-overrides