olih

#!/bin/bash
sudo yum install -y epel-release
sudo yum install -y nano
sudo yum install -y git

#Install Amazon Client
curl -O http://peak.telecommunity.com/dist/ez_setup.py
sudo python ez_setup.py
#Install pip
sudo easy_install pip

olih

#AWS
# . install-aws.sh
instance_profile=`curl http://169.254.169.254/latest/meta-data/iam/security-credentials/`
aws_access_key_id=`curl http://169.254.169.254/latest/meta-data/iam/security-credentials/${instance_profile} | grep AccessKeyId | cut -d':' -f2 | sed 's/[^0-9A-Z]*//g'`
aws_secret_access_key=`curl http://169.254.169.254/latest/meta-data/iam/security-credentials/${instance_profile} | grep SecretAccessKey | cut -d':' -f2 | sed 's/[^0-9A-Za-z/+=]*//g'`

aws_secret_access_key=`curl http://169.254.169.254/latest/meta-data/iam/security-credentials/${instance_profile} | grep SecretAccessKey | cut -d':' -f2 | sed 's/[^0-9A-Za-z/+=]*//g'`

aws_session_token=`curl http://169.254.169.254/latest/meta-data/iam/security-credentials/${instance_profile} | grep Token | cut -d':' -f2 | sed 's/[^0-9A-Za-z/+=]*//g'`

olih

Processing JSON using jq

jq is useful to slice, filter, map and transform structured json data.

Installing jq

On Mac OS

brew install jq

olih

awk & sed cheetsheet

Extract lines between start and end

between() { sed -n "/^$1/,/^$2/p" | sed '1d;$d'; }

Also:

awk '/^START=A$/,/^END$/ { print }’ data

olih

SSL cheetsheet

Encode file with password

alias enc='openssl enc -e -aes128 -base64 -pass "env:PASS"'

Decode file with password

alias dec='openssl enc -d -aes128 -base64 -pass "env:PASS"'

olih

My Bookmarks

Shell

• adds flavor of interactive filtering to the traditional pipe concept of UNIX shell
• seven-command-line-tools-for-data-science.html

Html/Css

• You might not need javascript

olih

Installation

On linux

sudo yum install -y epel-release
sudo yum install R

On Mac OS

olih

Redis Commands:

• APPEND key value Append a value to a key
• AUTH password Authenticate to the server
• BGREWRITEAOF Asynchronously rewrite the append-only file
• BGSAVE Asynchronously save the dataset to disk
• BITCOUNT key start end Count set bits in a string
• BITFIELD key GET type offset SET type offset value INCRBY type offset increment OVERFLOW WRAP|SAT|FAIL Perform arbitrary bitfield integer operations on strings
• BITOP operation destkey key key ... Perform bitwise operations between strings
• BITPOS key bit start end Find first bit set or clear in a string

olih

Scala

Convert Seq To Map

val map = seq.map(a => a.key -> a).toMap