Skip to content

Instantly share code, notes, and snippets.

View noemi-dresden's full-sized avatar
🎯
Focusing

Salohy Miarisoa noemi-dresden

🎯
Focusing
View GitHub Profile
@noemi-dresden
noemi-dresden / graphite_exporter.yml
Created March 28, 2019 19:24
Graphite exporter service
graphite_exporter:
image: prom/graphite-exporter
command: "--graphite.mapping-config=/tmp/graphite_mapping.conf"
container_name: graphite_exporter
volumes:
- path/to-your/graphite_mapping.conf:/tmp/graphite_mapping.conf
ports:
- "9108:9108"
- "9109:9109"
- "9109:9109/udp"
@noemi-dresden
noemi-dresden / graphite_mapping.conf
Created March 28, 2019 19:29
graphite_mapping conf file for spark
mappings:
- match: '*.*.jvm.*.*'
name: jvm_memory_usage
labels:
application: $1
executor_id: $2
mem_type: $3
qty: $4
- match: '*.*.jvm.pools.*.*'
@noemi-dresden
noemi-dresden / docker-compose.yml
Created March 28, 2019 19:44
Complete compose file for monitoring spark on prometheus
version: "3.1"
services:
spark-master:
image: bde2020/spark-master:2.4.0-hadoop2.7
container_name: spark-master
ports:
- "8080:8080"
- "7077:7077"
environment:
- INIT_DAEMON_STEP=setup_spark
@noemi-dresden
noemi-dresden / submit.sh
Last active March 28, 2019 20:24
spark submit in docker without metrics
docker run --name spark-app \
-e ENABLE_INIT_DAEMON=false \
--link spark-master:spark-master \
--network=same-network-as-master-and-worker \
spark-app
@noemi-dresden
noemi-dresden / Kafka-cluster.yml
Created July 18, 2019 12:32
Kafka cluster using docker swarm and confluentinc image, managed by kafka-manager
version: "3"
services:
zookeeper-1:
image: confluentinc/cp-zookeeper:latest
hostname: zookeeper-1
ports:
- "12181:12181"
environment:
ZOOKEEPER_SERVER_ID: 1
ZOOKEEPER_CLIENT_PORT: 12181