mariocesar

"""
 Requeriments:

     $ sudo pip install boto dnspython

 Edit ~/.boto to use your AWS credentials

"""
import time
import sys

thekuffs

{% if grains['os'] == 'Ubuntu' %}
  {% from "pkg_repo/apt.sls" import apt_repo with context %}
  {% if pillar['pkg_mirrors_enabled'] %}
    {% set mirrors = ['http://' + pillar['pkg_mirror'] + '/10gen/repo/upbuntu-upstart/',
                      'http://downloads-distro.mongodb.org/repo/ubuntu-upstart/'] %}
  {% else %}
    {% set mirrors = ['http://downloads-distro.mongodb.org/repo/ubuntu-upstart/'] %}
  {% endif %}
{{ apt_repo('10gen', mirrors, codename='dist', components=['10gen'], key_id='7F0CEB10') }}

lucasb-eyer

[ Launch Inlet ]Gist #3200444

louiszuckerman

I pass these options to the varnishncsa daemon (this line is from my /etc/init.d/varnishncsa)...

DAEMON_OPTS="-a -F "\''%h "%{X-Forwarded-For}i" %u %t "%r" %s %b "%{Referer}i" "%{User-agent}i" %{Varnish:time_firstbyte}x %{Varnish:handling}x'\'" -c -w ${LOGFILE} -D -P $PIDFILE"

I parse that with the following grok pattern...

VARNISHNCSALOG %{IPORHOST:remoteip} %{QUOTEDSTRING:xforwardedfor} %{USER:auth} \[%{HTTPDATE:timestamp}\] "%{WORD:verb} %{NOTSPACE:request} HTTP/%{NUMBER:httpversion}" (?:%{NUMBER:status}|\(null\)) (?:%{NUMBER:bytes}|-) "(?:%{NOTSPACE:referrer}|-)" %{QUOTEDSTRING:agent} %{BASE10NUM:berespms} %{WORD:cache}

tott

#!/usr/bin/env python
"""
Produces load on all available CPU cores
"""

from multiprocessing import Pool
from multiprocessing import cpu_count

def f(x):
    while True:

jordansissel

logstash queries graphed with graphite.

Operation: Decouple whisper from graphite.

Method: Create a graphite function that does a date histogram facet query against elasticsearch for a given query string for the time period viewed in the current graph.

Reason: graphite has some awesome math functions. Wouldn't it be cool if we could use those on logstash results?

The screenshot below is using logstash to watch the twitter stream of keywords "iphone" "apple" and "samsung" - then I graph them each, so we get an idea of popularity. As a bonus, I also do a movingAverage() on the iphone curve to show you why this is awesome.

llowder

require 'spec_helper'

describe 'elasticsearch', :type => 'class' do

  it do
    should contain_file('elastic_conf').with(
      {
        'ensure' => 'present',
        'path' => '/opt/elasticsearch/config/elasticsearch.yml'
      })

HeartSaVioR

# -*- encoding: utf-8 -*-

import sys
#print sys.argv

if len(sys.argv) < 3:
  print "usage: %s [start] [end]" % sys.argv[0]
  sys.exit(1)

start = int(sys.argv[1])

jgeurts

####################################
# BASIC REQUIREMENTS
# http://graphite.wikidot.com/installation
# http://geek.michaelgrace.org/2011/09/how-to-install-graphite-on-ubuntu/
# Last tested & updated 10/13/2011
####################################

cd
sudo apt-get update
sudo apt-get upgrade

westwickfarrow

cd ~
sudo add-apt-repository ppa:dlecan/openjdk
sudo apt-get update
sudo apt-get install openjdk-7-jre -y

wget https://github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.7.tar.gz -O elasticsearch.tar.gz
tar -xf elasticsearch.tar.gz
rm elasticsearch.tar.gz
sudo mv elasticsearch-* elasticsearch
sudo mv elasticsearch /usr/local/share