XC xchehub

Rationale

This snippet is a sample showing how to implement CloudWatch Logs streaming to ElasticSearch using terraform. I wrote this gist because I didn't found a clear, end-to-end example on how to achieve this task. In particular, I understood the resource "aws_lambda_permission" "cloudwatch_allow" part by reading a couple of bug reports plus this stackoverflow post.

The js file is actually the Lambda function automatically created by AWS when creating this pipeline through the web console. I only added a endpoint variable handling so it is configurable from terraform.

Scaling your API with rate limiters

The following are examples of the four types rate limiters discussed in the accompanying blog post. In the examples below I've used pseudocode-like Ruby, so if you're unfamiliar with Ruby you should be able to easily translate this approach to other languages. Complete examples in Ruby are also provided later in this gist.

In most cases you'll want all these examples to be classes, but I've used simple functions here to keep the code samples brief.

Request rate limiter

This uses a basic token bucket algorithm and relies on the fact that Redis scripts execute atomically. No other operations can run between fetching the count and writing the new count.

Sessions

Code	Title	Duration	Link
Keynote	Andy Jassy Keynote Announcement Recap	0:01	https://www.youtube.com/watch?v=TZCxKAM2GtQ
Keynote	AWS re:Invent 2016 Keynote: Andy Jassy	2:22	https://www.youtube.com/watch?v=8RrbUyw9uSg
Keynote	AWS re:Invent 2016 Keynote: Werner Vogels	2:16	https://www.youtube.com/watch?v=ZDScBNahsL4
Keynote	[Tuesday Night Live with Jame

FWIW: I (@rondy) am not the creator of the content shared here, which is an excerpt from Edmond Lau's book. I simply copied and pasted it from another location and saved it as a personal note, before it gained popularity on news.ycombinator.com. Unfortunately, I cannot recall the exact origin of the original source, nor was I able to find the author's name, so I am can't provide the appropriate credits.

Effective Engineer - Notes

By Edmond Lau
Highly Recommended 👍
http://www.theeffectiveengineer.com/

	[core]
	quotepath = false # 中文檔名如實顯示而不轉碼
	autocrlf = false # commit 及 checkout 時不根據作業系統轉換檔案的換行字元 (避免不小心改動原 repo 的換行字元)
	safecrlf = false # 檢查文字類檔案是否混合了 CRLF 及 LF 換行字元 (搭配 autocrlf，這裡一起關閉)
	ignorecase = false # 檔名大小寫不同時視為相異 (更動大小寫才能 commit)
	whitespace = cr-at-eol # diff 時行尾 CRLF 不顯示 ^M
	fileMode = false # 忽略檔案的 x 屬性 (for Windows)
	symlinks = false # 忽略符號連結 (for Windows)
	editor = /usr/bin/vim # 預設的文字編輯器 (for Linux)
	[alias]

	/*
	* Copyright 2017 Piruin Panichphol
	*
	* Licensed under the Apache License, Version 2.0 (the "License");
	* you may not use this file except in compliance with the License.
	* You may obtain a copy of the License at
	*
	* http://www.apache.org/licenses/LICENSE-2.0
	*
	* Unless required by applicable law or agreed to in writing, software

	import boto3

	ec2 = boto3.resource('ec2')

	def lambda_handler(event, context):
	# create filter for instances in running state
	filters = [
	{
	'Name': 'instance-state-name',
	'Values': ['running']

	library(quantstrat)
	library(magrittr)

	Xt = getSymbols('2498.TW', auto.assign = F)

	# 1st Step: Attach MA indicators onto symbol
	Xt$MA5 = Xt %>% Cl %>% SMA(5)
	Xt$MA60 = Xt %>% Cl %>% SMA(60)