Ajay Matai amatai

Run Kafka, ZK in container

docker run -d -p 2181:2181 --name zookeeper jplock/zookeeper
docker run -d -p 9092:9092 --name kafka --link zookeeper:zookeeper ches/kafka

./kafka-topics --zookeeper localhost:2181 --list

# kafka, zk all running as containers

sudo docker run --rm --link zookeeper:zookeeper ches/kafka kafka-console-consumer.sh --topic audit --from-beginning --zookeeper zookeeper:2181

curl http://localhost:9200/?pretty

curl http://localhost:9200/_cluster/health?pretty

Layer 3 level

Known Problem:

Mitigations by AWS

Route53 monitors health of ELB instances and if it is fails because DDoS targetting particular instance, it will remove it from pool, good traffic continues.

	$ mktmpenv -p `which python3.7`
	Running virtualenv with interpreter /usr/bin/python3.7
	Using base prefix '/usr'
	/usr/lib/python3/dist-packages/virtualenv.py:1086: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
	import imp
	New python executable in /home/ajay/.virtualenvs/tmp-bf135004fa2bf83f/bin/python3.7
	Also creating executable in /home/ajay/.virtualenvs/tmp-bf135004fa2bf83f/bin/python
	Installing setuptools, pkg_resources, pip, wheel...done.
	This is a temporary environment. It will be deleted when you run 'deactivate'.
	(tmp-bf135004fa2bf83f) [~/.virtualenvs/tmp-bf135004fa2bf83f]$

	#!/usr/bin/env python3.6

	import asyncio
	import signal


	async def taskX(task_name, loop):
	while True:
	try:
	# simulate long running task