Kong Mu visualskyrim

visualskyrim / kafka_consumer.logstash

Created June 13, 2017 13:00

Simple Kafka consumer

	input {
	kafka {
	group_id => "flink-test"
	topics => ["flink-test"]
	bootstrap_servers => "localhost:9092"
	}
	}
	output {
	stdout {}
	}

visualskyrim / DataTransfer.java

Created June 13, 2017 13:20

Simple Flink job streaming data from Kafka to local files.

	import org.apache.flink.api.common.restartstrategy.RestartStrategies;
	import org.apache.flink.api.java.utils.ParameterTool;
	import org.apache.flink.streaming.api.CheckpointingMode;
	import org.apache.flink.streaming.api.datastream.DataStream;
	import org.apache.flink.streaming.api.environment.CheckpointConfig;
	import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment;
	import org.apache.flink.streaming.connectors.fs.bucketing.BucketingSink;
	import org.apache.flink.streaming.connectors.fs.bucketing.DateTimeBucketer;
	import org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08;
	import org.apache.flink.streaming.util.serialization.SimpleStringSchema;

visualskyrim / deploy_authorized_keys.yml

Created November 9, 2017 06:28

deploy_public_key_as_same_user.yml

	---
	- hosts: all
	tasks:
	- name: make direcotry
	file:
	path: "/home/<username>/.ssh"
	state: directory
	- name: create empty file
	file:
	path: "/home/<username>/.ssh/authorized_keys"

visualskyrim / gist:a2d0bc6541fa6709c79afdf1e524e086

Created November 9, 2017 06:30

Execute deploy_authorized_keys.yml as the same user as that in remote host

ansible-playbook -i <inventory-file> deploy_authorized_keys.yml --ask-pass --extra-vars='pubkey="<pubkey>"'

visualskyrim / ansible.cfg

Created November 9, 2017 06:32

	[defaults]
	host_key_checking = False

visualskyrim / deploy_authorized_keys.yml

Created November 9, 2017 06:38

visualskyrim / gist:16b13e028851a2ba1b0b133ee76ca943

Created November 9, 2017 06:39

ansible-playbook -i <inventory-file> deploy_authorized_keys.yml --ask-become-pass --ask-pass --extra-vars='pubkey="<pubkey-for-super-user>”’

visualskyrim / change_ulimit.yml

Created November 27, 2017 02:34

Ansible: Change ulimit

	- hosts: all
	become: true
	tasks:
	- name: configure system settings, file descriptors and number of threads
	pam_limits:
	domain: ratuser
	limit_type: "{{item.limit_type}}"
	limit_item: "{{item.limit_item}}"
	value: "{{item.value}}"
	with_items:

visualskyrim / modify_ulimit.yml

Last active August 18, 2022 09:27

A ansible playbook to modify ulimit

	- hosts: all
	become: true
	tasks:
	- name: configure system settings, file descriptors and number of threads
	pam_limits:
	domain: <--your-username-->
	limit_type: "{{item.limit_type}}"
	limit_item: "{{item.limit_item}}"
	value: "{{item.value}}"
	with_items:

visualskyrim / docker-compose.yml

Created December 27, 2017 14:16

Docker Compose File: influxdb + grafana