Logstash development

logstash_develop.md

Preconfigure ** Important ***

1. Install rvm https://rvm.io/

2. Install jruby

   rvm install jruby

3. use jruby

   rvm jruby

Logstash build

1. clone project from https://github.com/elastic/logstash.git

2. bootstrap the environment

   rake bootstrap

3. install logstash core modules

   rake test:install-core

4. run the logstash core tests you can use the rake task

   rake test:core

5. Install set of plugins

   rake test:install-all

Develop logstash plugin

1. Clone an example plugin input plugin, filter plugin, codec plugin, output plugin

2. Write your own plugin

3. Build and tests your plugin

   build your plugin gem

   gem build logstash-filter-awesome.gemspec

   Install the plugin from the Logstash home

   bin/plugin install /your/local/plugin/logstash-filter-awesome.gem

Start Logstash and proceed to test the plugin

Example

1. https://github.com/logstash-plugins/logstash-filter-throttle
2. https://github.com/logstash-plugins/logstash-output-syslog
3. https://github.com/logstash-plugins/logstash-codec-cef
4. https://github.com/Hewlett-Packard-ESS/logstash-codec-cef

Guide

https://www.elastic.co/guide/en/logstash/current/plugins-filters-throttle.html
https://www.elastic.co/guide/en/logstash/current/plugins-inputs-redis.html
https://www.elastic.co/guide/en/logstash/current/_how_to_write_a_logstash_filter_plugin.html