Oluwashina Aladejubelo odidere

DevOps Engineer Interview Questions

Shakespeare Sonnet++ Postmortem (incident #465)

Date

2015-10-21

Authors

jennifer
martym

A curated list of AWS resources to prepare for the AWS Certifications

A curated list of awesome AWS resources you need to prepare for the all 5 AWS Certifications. This gist will include: open source repos, blogs & blogposts, ebooks, PDF, whitepapers, video courses, free lecture, slides, sample test and many other resources.

Kafka Topics

List existing topics

bin/kafka-topics.sh --zookeeper localhost:2181 --list

Describe a topic

bin/kafka-topics.sh --zookeeper localhost:2181 --describe --topic mytopic

Purge a topic

bin/kafka-topics.sh --zookeeper localhost:2181 --alter --topic mytopic --config retention.ms=1000

... wait a minute ...

Get started with Ansible in 2 minutes

Install Ansible

$ brew install ansible            # OSX
$ [sudo] pip install ansible # elsewhere

	version: '2'
	services:
	myapp:
	build: .
	container_name: "myapp"
	image: debian/latest
	environment:
	- NODE_ENV=development
	- FOO=bar
	volumes:

	# Reference:
	https://www.cloudgear.net/blog/2015/5-minutes-kubernetes-setup/

	# install homebrew and cask
	ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

	# install virtualbox
	brew cask install virtualbox

	# install dockertoolbox

	from airflow.models import BaseOperator
	import logging
	from subprocess import Popen, STDOUT, PIPE
	from airflow.exceptions import AirflowException, AirflowTaskTimeout
	from airflow.utils.decorators import apply_defaults

	'''
	SparkOperator for airflow designed to simplify work with Spark on YARN.
	Simplifies using spark-submit in airflow DAGs, retrieves application id
	and tracking URL from logs and ensures YARN application is killed on timeout.

	from airflow.models import BaseOperator
	import logging
	from subprocess import Popen, STDOUT, PIPE
	from airflow.exceptions import AirflowException, AirflowTaskTimeout
	from airflow.utils.decorators import apply_defaults

	'''
	SparkOperator for airflow designed to simplify work with Spark on YARN.
	Simplifies using spark-submit in airflow DAGs, retrieves application id
	and tracking URL from logs and ensures YARN application is killed on timeout.

	----------------------------------------------------------------
	-- Streams - Change Data Capture (CDC) on Snowflake tables
	-- Tasks - Schedule execution of a statement
	-- MERGE - I/U/D based on second table or subquery
	----------------------------------------------------------------

	-- reset the example
	drop table source_table;
	drop table target_table;
	drop stream source_table_stream;