Skip to content

Instantly share code, notes, and snippets.

@meitei11
Created September 11, 2018 09:39
Show Gist options
  • Save meitei11/79924d00c6f97cbdfdb081603b9f4154 to your computer and use it in GitHub Desktop.
Save meitei11/79924d00c6f97cbdfdb081603b9f4154 to your computer and use it in GitHub Desktop.
sample filebeat configuration for writing to kafka and picking from a list of prospectors
filebeat.config.prospectors:
enabled: true
path: /mnt/filebeat/prospectors/*.yml
reload.enabled: true
reload.period: 10s
output.kafka:
hosts: ["kafka1:9092","kafka2:9092","kafka3:9092"]
topic: '%{[fields.log_topic]}'
partition.round_robin:
reachable_only: false
required_acks: 1
compression: gzip
max_message_bytes: 1000000
version: 0.11.0.0
logging.level: warning
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment