Skip to content

Instantly share code, notes, and snippets.

@piavlo
piavlo / gist:5432632
Last active December 16, 2015 12:09
fails after running for some time
/opt/sensu/embedded/lib/ruby/gems/2.0.0/gems/sensu-dashboard-0.9.9/lib/sensu-dashboard/server.rb:185:in `load': no object read at line 1, column 1 [load.c:1073] (Oj::ParseError)
from /opt/sensu/embedded/lib/ruby/gems/2.0.0/gems/sensu-dashboard-0.9.9/lib/sensu-dashboard/server.rb:185:in `block (2 levels) in <class:Server>'
from /opt/sensu/embedded/lib/ruby/gems/2.0.0/gems/eventmachine-1.0.3/lib/em/deferrable.rb:151:in `call'
from /opt/sensu/embedded/lib/ruby/gems/2.0.0/gems/eventmachine-1.0.3/lib/em/deferrable.rb:151:in `set_deferred_status'
from /opt/sensu/embedded/lib/ruby/gems/2.0.0/gems/eventmachine-1.0.3/lib/em/deferrable.rb:191:in `succeed'
from /opt/sensu/embedded/lib/ruby/gems/2.0.0/gems/em-http-request-1.0.3/lib/em-http/client.rb:113:in `unbind'
from /opt/sensu/embedded/lib/ruby/gems/2.0.0/gems/em-http-request-1.0.3/lib/em-http/client.rb:71:in `on_request_complete'
from /opt/sensu/embedded/lib/ruby/gems/2.0.0/gems/em-http-request-1.0.3/lib/em-htt
metrics {
tags => [ "apache-accesslog" ]
meter => [ "http.%{appenv}.status.%{status}" ]
add_tag => [ "apache-metrics" ]
past_seconds => 9
}
{
"template": "logstash-*",
"settings" : {
"number_of_shards" : 1,
"number_of_replicas" : 0,
"index" : {
"query" : { "default_field" : "@message" },
"store" : { "compress" : { "stored" : true, "tv": true } }
}
},
@piavlo
piavlo / gist:4575152
Created January 19, 2013 21:10
pruning empty fields from a message
input {
generator {
type => "stdin"
lines => [ "this is an %{empty.match} in a string" ]
count => 1
}
}
filter {
mutate {
input {
redis {
data_type => "list"
host => "10.0.0.1"
key => "q1"
port => 6379
type => "redis2_q1"
threads => 1
batch_events => 100
}
@piavlo
piavlo / indexer-apache-accesslog.conf
Created January 15, 2013 23:54
indexer-apache-errorlog.conf is causing the slowness problem, even though there are ZERO event in it's flow
input {
redis {
host => "log1a.us-east-1"
type => "apache-accesslog"
data_type => "list"
key => "logstash:apache:accesslog"
message_format => "json_event"
charset => "UTF-8"
db => 0
debug => false
@piavlo
piavlo / disk rsync mirror
Created January 15, 2013 17:55
rsync per defined local filesystem in /etc/fstab finds all mountpoint that start with /backup like /backup/path and backups /path to /backup/path
#!/bin/bash
exec > /var/log/`basename ${0}`.log 2>&1
echo "############ `date` ###########"
for bkdir in `cat /etc/fstab | egrep -v -e '^#' | egrep -e '[[:space:]]/backup' | awk '{print $2}'` ; do
mount | egrep -e '[[:space:]]'${bkdir}'[[:space:]]' > /dev/null
if [ $? == 0 ]; then
dir=`echo ${bkdir} | sed -e 's#/backup##' `
[ "X${dir}" == "X" ] && dir="/"
mount | egrep -e '[[:space:]]'${dir}'[[:space:]]' > /dev/null
@piavlo
piavlo / adduser
Last active January 9, 2017 17:37
logstash init script for centos 5/6 requires daemonize binary and unpacked monolitic jar under /opt/logstash
adduser --home-dir /var/lib/logstash --no-create-home --shell /sbin/nologin logstash
mkdir -p /var/lib/logstash /var/log/logstash
chown -R logstash:logstash /var/lib/logstash /var/log/logstash
@piavlo
piavlo / gist:4428848
Created January 1, 2013 17:36
failure procs
@@ -30,9 +30,16 @@
@logger.fatal('SENSU NOT RUNNING!')
exit 2
end
+ connection_auth_failure = Proc.new do
+ @logger.fatal('cannot auth to rabbitmq', {
+ :settings => @settings[:rabbitmq]
+ })
+ @logger.fatal('SENSU NOT RUNNING!')
+ exit 2
@piavlo
piavlo / gist:4379593
Created December 26, 2012 10:56
mail2gearman
#!/usr/bin/env ruby
require 'rubygems'
require 'mail'
require 'yaml'
require 'pp'
require 'json'
require 'gearman'
settings = YAML.load_file('/ssa/.settings')