logstash-debug.md

First node (24 cores):

sudo sh -c "ulimit -n 1000000; setuidgid $USER env JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64 ES_HEAP_SIZE=2g bin/elasticsearch -Des.network.bind_host=0.0.0.0 -Des.network.publish_host=_eth0:ipv4_ -Des.discovery.zen.ping.unicast.hosts=bigstep003 -Des.discovery.zen.ping.multicast.enabled=false -Des.cluster.name=drewr -Des.logger.level=DEBUG"

Second node (8 cores):

sudo sh -c "ulimit -n 1000000; setuidgid $USER env JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64 ES_HEAP_SIZE=2g bin/elasticsearch -Des.network.bind_host=0.0.0.0 -Des.network.publish_host=_eth3:ipv4_ -Des.discovery.zen.ping.unicast.hosts=bigstep001 -Des.discovery.zen.ping.multicast.enabled=false -Des.cluster.name=drewr -Des.logger.level=DEBUG"

Logstash running on the first node:

sudo sh -c "ulimit -n 1000000; setuidgid $USER env JAVA_OPTS=\"-XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+PrintGCDetails -Xloggc:gc.log\" LS_HEAP_SIZE=10g bin/logstash -f ../generator.conf"

generator.conf (logstash config)

input {
  generator {
    type => "generator"
    lines => [
      "quick brown fox!"
    ]
  }
}

filter { }

output {
  elasticsearch {
    host => "bigstep003"
    cluster => "drewr"
    index => "logstash-debug"
    workers => 16
    flush_size => 5000
  }
}