fluentd_install.md

install

Amazon Linux1

$ curl -L https://toolbelt.treasuredata.com/sh/install-amazon1-td-agent3.sh | sh

自動起動

$ sudo chkconfig td-agent on
$ sudo chkconfig --list td-agent
td-agent       	0:off	1:off	2:on	3:on	4:on	5:on	6:off

起動

$ sudo service td-agent start

ps 確認

$ ps wf -C ruby -C td-agent
  PID TTY      STAT   TIME COMMAND
 3154 ?        Sl     0:00 /opt/td-agent/embedded/bin/ruby /usr/sbin/td-agent --log /var/log/td-agent/td-agent.log --use-v1-config --gr
 3159 ?        Sl     0:00  \_ /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /usr/sbin/td-agent --log /var/log/td-agent/td-ag

test

<source>
  @type forward
  @id input_forward
  port 24224
</source>
<match debug.**>
  @type stdout
  @id output_stdout
</match>

$ echo '{"user":"1","message":"Hello World."}' | /opt/td-agent/embedded/bin/fluent-cat debug.test

plugin

$ /usr/sbin/td-agent-gem install fluent-plugin-elasticsearch

ユーサー

$ sudo vi /etc/sysconfig/td-agent
TD_AGENT_USER=root
TD_AGENT_GROUP=root

監視

プロセス監視

wget https://github.com/tkuchiki/mackerel-plugin-linux-proc-stats/releases/download/v0.3/mackerel-plugin-linux-proc-stats_linux_amd64.zip
unzip mackerel-plugin-linux-proc-stats_linux_amd64.zip
mv mackerel-plugin-linux-proc-stats /etc/td-agent/plugin/bin
# ./plugin/bin/mackerel-plugin-linux-proc-stats -pidfile /var/run/td-agent/td-agent.pid -follow-child-processes
ruby_process.num.running	0.000000	1531808869
ruby_process.num.processes	2.000000	1531808869
ruby_process.num.threads	12.000000	1531808869
ruby_process.cpu.usage	0.114319	1531808869
ruby_process.memory.vsize	476004352.000000	1531808869
ruby_process.memory.rss	54706176.000000	1531808869

/usr/sbin/td-agent-gem install fluent-plugin-ping-message
/usr/sbin/td-agent-gem install fluent-plugin-slack

ファイルディスクリプタ

vi /etc/security/limits.conf
root soft nofile 65535
root hard nofile 65535

TCP_WAIT

vi /etc/sysctl.conf
net.ipv4.tcp_tw_recycle = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.ip_local_port_range = 10240

takaheraw/fluentd_install.md

install

監視