Skip to content

Instantly share code, notes, and snippets.

@katsyoshi
Last active May 31, 2016 07:38
Show Gist options
  • Select an option

  • Save katsyoshi/e242e514eb32c4089a5d5aadbc80830f to your computer and use it in GitHub Desktop.

Select an option

Save katsyoshi/e242e514eb32c4089a5d5aadbc80830f to your computer and use it in GitHub Desktop.
failed upgrade fluentd-0.12 to 0.14
<match td.*.*>
@type tdlog
apikey YOUR_API_KEY
auto_create_table
buffer_type file
buffer_path /var/log/td-agent/buffer/td
<secondary>
@type file
path /var/log/td-agent/failed_records
</secondary>
</match>
2016-05-31 16:03:02 +0900 [info]: Worker 0 finished unexpectedly with status 1
2016-05-31 16:03:03 +0900 [info]: reading config file path="/etc/td-agent/td-agent.conf"
2016-05-31 16:03:03 +0900 [info]: starting fluentd-0.14.0 without supervision
2016-05-31 16:03:03 +0900 [info]: gem 'fluent-mixin-config-placeholders' version '0.4.0'
2016-05-31 16:03:03 +0900 [info]: gem 'fluent-mixin-plaintextformatter' version '0.2.6'
2016-05-31 16:03:03 +0900 [info]: gem 'fluent-plugin-mongo' version '0.7.12'
2016-05-31 16:03:03 +0900 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '1.5.5'
2016-05-31 16:03:03 +0900 [info]: gem 'fluent-plugin-s3' version '0.6.8'
2016-05-31 16:03:03 +0900 [info]: gem 'fluent-plugin-td' version '0.10.28'
2016-05-31 16:03:03 +0900 [info]: gem 'fluent-plugin-td-monitoring' version '0.2.2'
2016-05-31 16:03:03 +0900 [info]: gem 'fluent-plugin-webhdfs' version '0.5.1'
2016-05-31 16:03:03 +0900 [info]: gem 'fluentd' version '0.14.0'
2016-05-31 16:03:03 +0900 [info]: adding match pattern="td.*.*" type="tdlog"
2016-05-31 16:03:03 +0900 [warn]: secondary type should be same with primary one primary="Fluent::TreasureDataLogOutput" secondary="Fluent::FileOutput"
2016-05-31 16:03:03 +0900 [error]: unexpected error error="undefined method `buffer_chunk_limit=' for #<Fluent::Plugin::FileBuffer:007fb6de21b2f8>"
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluent-plugin-td-0.10.28/lib/fluent/plugin/out_tdlog.rb:62:in `configure'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/agent.rb:135:in `add_match'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/agent.rb:69:in `block in configure'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/agent.rb:63:in `each'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/agent.rb:63:in `configure'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/root_agent.rb:86:in `configure'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/engine.rb:119:in `configure'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/engine.rb:93:in `run_configure'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:576:in `run_configure'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:381:in `block in run_worker'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:509:in `call'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:509:in `main_process'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/supervisor.rb:378:in `run_worker'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/lib/fluent/command/fluentd.rb:266:in `<top (required)>'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/site_ruby/2.1.0/rubygems/core_ext/kernel_require.rb:73:in `require'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/site_ruby/2.1.0/rubygems/core_ext/kernel_require.rb:73:in `require'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.14.0/bin/fluentd:5:in `<top (required)>'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/bin/fluentd:23:in `load'
2016-05-31 16:03:03 +0900 [error]: /opt/td-agent/embedded/bin/fluentd:23:in `<top (required)>'
2016-05-31 16:03:03 +0900 [error]: /usr/sbin/td-agent:7:in `load'
2016-05-31 16:03:03 +0900 [error]: /usr/sbin/td-agent:7:in `<main>'
2016-05-31 16:03:03 +0900 [info]: Received graceful stop
2016-05-31 16:03:03 +0900 [info]: Worker 0 finished with status 1
<match td.*.*>
@type tdlog
apikey YOUR_API_KEY
auto_create_table
buffer_type file
buffer_path /var/log/td-agent/buffer/td
buffer_chunk_limit 10
<secondary>
@type file
path /var/log/td-agent/failed_records
</secondary>
</match>
2016-05-31 16:19:34 +0900 [info]: starting fluentd-0.14.0
2016-05-31 16:19:34 +0900 [info]: spawn command to main: /opt/td-agent/embedded/bin/ruby -Eascii-8bit:ascii-8bit /usr/sbin/td-agent --log /var/log/td-agent/td-agent.log --use-v1-config --no-supervisor
2016-05-31 16:19:34 +0900 [info]: reading config file path="/etc/td-agent/td-agent.conf"
2016-05-31 16:19:34 +0900 [info]: starting fluentd-0.14.0 without supervision
2016-05-31 16:19:34 +0900 [info]: gem 'fluent-mixin-config-placeholders' version '0.4.0'
2016-05-31 16:19:34 +0900 [info]: gem 'fluent-mixin-plaintextformatter' version '0.2.6'
2016-05-31 16:19:34 +0900 [info]: gem 'fluent-plugin-mongo' version '0.7.12'
2016-05-31 16:19:34 +0900 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '1.5.5'
2016-05-31 16:19:34 +0900 [info]: gem 'fluent-plugin-s3' version '0.6.8'
2016-05-31 16:19:34 +0900 [info]: gem 'fluent-plugin-td' version '0.10.28'
2016-05-31 16:19:34 +0900 [info]: gem 'fluent-plugin-td-monitoring' version '0.2.2'
2016-05-31 16:19:34 +0900 [info]: gem 'fluent-plugin-webhdfs' version '0.5.1'
2016-05-31 16:19:34 +0900 [info]: gem 'fluentd' version '0.14.0'
2016-05-31 16:19:34 +0900 [info]: adding match pattern="td.*.*" type="tdlog"
2016-05-31 16:19:35 +0900 [warn]: secondary type should be same with primary one primary="Fluent::TreasureDataLogOutput" secondary="Fluent::FileOutput"
2016-05-31 16:19:35 +0900 [info]: adding match pattern="debug.**" type="stdout"
2016-05-31 16:19:35 +0900 [info]: adding source type="forward"
2016-05-31 16:19:35 +0900 [info]: adding source type="http"
2016-05-31 16:19:35 +0900 [info]: adding source type="debug_agent"
2016-05-31 16:19:35 +0900 [info]: using configuration file: <ROOT>
<match td.*.*>
@type tdlog
apikey xxxxxx
auto_create_table
buffer_type "file"
buffer_path /var/log/td-agent/buffer/td
buffer_chunk_limit 10
<secondary>
@type "file"
path "/var/log/td-agent/failed_records"
buffer_path /var/log/td-agent/failed_records.*
<buffer time>
flush_mode lazy
retry_type exponential_backoff
path /var/log/td-agent/failed_records.*
timekey 86400
</buffer>
</secondary>
<buffer>
flush_mode interval
retry_type exponential_backoff
@type file
path /var/log/td-agent/buffer/td
chunk_limit_size 10
</buffer>
</match>
<match debug.**>
@type stdout
</match>
<source>
@type forward
</source>
<source>
@type http
port 8888
</source>
<source>
@type debug_agent
bind "127.0.0.1"
port 24230
</source>
</ROOT>
2016-05-31 16:19:35 +0900 [warn]: section <buffer> is not used in <secondary>
2016-05-31 16:19:35 +0900 [info]: listening dRuby uri="druby://127.0.0.1:24230" object="Engine"
2016-05-31 16:19:35 +0900 [info]: listening fluent socket on 0.0.0.0:24224
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment