Yuvaraj L skyrocknroll

Next Steps

Measure time spend on index, flush, refresh, merge, query, etc. (TD - done)
Take hot threads snapshots under read+write, read-only, write-only (TD - done)
Adjust refresh time to 10s (from 1s) and see how load changes (TD)
Measure time of a rolling restart doing disable_flush and disable_recovery (TD)
Specify routing on query -- make it choose same node for each shard each time (MD)
GC new generation size (TD)
Warmers

measure before/after of client query time with and without warmers (MD)

#System Design Cheatsheet

Picking the right architecture = Picking the right battles + Managing trade-offs

##Basic Steps

Clarify and agree on the scope of the system

User cases (description of sequences of events that, taken together, lead to a system doing something useful)
- Who is going to use it?
- How are they going to use it?

chartFactory

/affini-tech/ChartFactory

Based on D3.JS and Dimple, ChartFactory provide the ability to build quickly D3.JS charts without coding any lines of javascript. Just define your dashboard in a JSON and voila !

charts: [
        {id:'chart1',
         width:800,height:250,

xAxis:{type:'Category',field: "Month",orderRule:'Date'},


	#
	# A CORS (Cross-Origin Resouce Sharing) config for nginx
	#
	# == Purpose
	#
	# This nginx configuration enables CORS requests in the following way:
	# - enables CORS just for origins on a whitelist specified by a regular expression
	# - CORS preflight request (OPTIONS) are responded immediately
	# - Access-Control-Allow-Credentials=true for GET and POST requests

	#
	# Acts as a nginx HTTPS proxy server
	# enabling CORS only to domains matched by regex
	# /https?://.*\.mckinsey\.com(:[0-9]+)?)/
	#
	# Based on:
	# * http://blog.themillhousegroup.com/2013/05/nginx-as-cors-enabled-https-proxy.html
	# * http://enable-cors.org/server_nginx.html
	#
	server {

	##################################################################
	# /etc/elasticsearch/elasticsearch.yml
	#
	# Base configuration for a write heavy cluster
	#

	# Cluster / Node Basics
	cluster.name: logng

	# Node can have abritrary attributes we can use for routing

	- What do Etcd, Consul, and Zookeeper do?
	- Service Registration:
	- Host, port number, and sometimes authentication credentials, protocols, versions
	numbers, and/or environment details.
	- Service Discovery:
	- Ability for client application to query the central registry to learn of service location.
	- Consistent and durable general-purpose K/V store across distributed system.
	- Some solutions support this better than others.
	- Based on Paxos or some derivative (i.e. Raft) algorithm to quickly converge to a consistent state.
	- Centralized locking can be based on this K/V store.

	http://d.stavrovski.net/blog/post/how-to-install-and-setup-oracle-java-jdk-in-centos-6

	# rpm
	wget --no-cookies \
	--no-check-certificate \
	--header "Cookie: oraclelicense=accept-securebackup-cookie" \
	"http://download.oracle.com/otn-pub/java/jdk/7u55-b13/jdk-7u55-linux-x64.rpm" \
	-O jdk-7-linux-x64.rpm

	# ubuntu

	[program:tomcat6]
	command=/opt/tomcat6-instance/bin/supervisor-wrapper.sh

	check host appsrv1 with address 127.0.0.1
	start program = "/sbin/start myapp"
	stop program = "/sbin/stop myapp"
	alert [email protected] on {timeout,connection}
	if failed port 9009 protocol HTTP
	request /
	with timeout 3 seconds
	then restart
	if 10 restarts within 10 cycles then timeout
	if 10 restarts within 10 cycles then exec "/usr/bin/monit start aws-dns-healthcheck"