Skip to content

Instantly share code, notes, and snippets.

@t0mmyt
Last active July 17, 2017 15:08
Show Gist options
  • Save t0mmyt/5a8602ea8b16f47e4b6731a20e56af6e to your computer and use it in GitHub Desktop.
Save t0mmyt/5a8602ea8b16f47e4b6731a20e56af6e to your computer and use it in GitHub Desktop.
X->Kafka->Logstash->Elasticsearch->Kibana
+-----------+
|Kinesis |-----\
+-----------+ ---------\ +-----------+
---------\ |Logstash | +-------------+
+-----------+ ------ +-----------+ |Elasticsearch| +-------------+
|Loglet |-\ |-----------| |Client | |Kibana |
+-----------+ -\ +--------------------+ -|-----------|---+-------------+---| |
-\ | | / |-----------| |-------------| +-------------+
+-----------+ --| |/ |-----------| +-------------+
|Fluentd |--------| Kafka / +-----------+ | \
+-----------+ --| | | \
-// | | +-------------+ -+-------------+
+-----------+ -/ / +--------------------+ |Elasticsearch| |Elasticsearch|
|Filebeats |-/ / |Data |---|Master |
+-----------+ / +-------------+ +-------------+
/ |-------------| |-------------|
+-----------+ / |-------------| +-------------+
|Sqskaf |/ → DATA → |-------------|
+-----------+ |-------------|
+-------------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment