ololo-psh’s gists

ololo-psh / 2013-01-07-profiling-memory-leaky-sidekiq-applications-with-ruby-2.1.md

Created October 22, 2015 19:18 — forked from krasnoukhov/2013-01-07-profiling-memory-leaky-sidekiq-applications-with-ruby-2.1.md

Profiling memory leaky Sidekiq applications with Ruby 2.1

My largest Sidekiq application had a memory leak and I was able to find and fix it in just few hours spent on analyzing Ruby's heap. In this post I'll show my profiling setup.

As you might know Ruby 2.1 introduced a few great changes to ObjectSpace, so now it's much easier to find a line of code that is allocating too many objects. Here is great post explaining how it's working.

I was too lazy to set up some seeding and run it locally, so I checked that test suite passes when profiling is enabled and pushed debugging to production. Production environment also suited me better since my jobs data can't be fully random generated.

So, in order to profile your worker, add this to your Sidekiq configuration:

if ENV["PROFILE"]

ololo-psh / puma.monitrc

Created October 22, 2015 18:36 — forked from sudara/puma.monitrc

Example config needed to use monit with puma, monitoring workers for mem.

	# this monit config goes in /etc/monit/conf.d

	check process puma_master
	with pidfile /data/myapp/current/tmp/puma.pid
	start program = "/etc/monit/scripts/puma start"
	stop program = "/etc/monit/scripts/puma stop"
	group myapp

	check process puma_worker_0
	with pidfile /data/myapp/current/tmp/puma_worker_0.pid

ololo-psh / monit_sidekiq

Created October 22, 2015 15:26 — forked from jlecour/monit_sidekiq

Monit configuration for 2 Sidekiq processes, with Rbenv.

	check process sidekiq_01
	with pidfile /path/to/app/current/tmp/pids/sidekiq.pid
	start program = "/bin/sh -c 'cd /path/to/app/current; PATH=bin:/path/to/rbenv/shims:/path/to/rbenv/bin:$PATH nohup bundle exec sidekiq -e production -i 0 -P tmp/pids/sidekiq.pid >> log/sidekiq.log 2>&1 &'" as uid app_user and gid app_group with timeout 90 seconds
	stop program = "/bin/sh -c 'cd /path/to/app/current; PATH=bin:/path/to/rbenv/shims:/path/to/rbenv/bin:$PATH bundle exec sidekiqctl stop tmp/pids/sidekiq.pid'" as uid app_user and gid app_group with timeout 90 seconds
	if totalmem is greater than 500 MB for 2 cycles then restart # eating up memory?
	group sidekiq

	check process sidekiq_02
	with pidfile /path/to/app/current/tmp/pids/sidekiq.pid-1
	start program = "/bin/sh -c 'cd /path/to/app/current; PATH=bin:/path/to/rbenv/shims:/path/to/rbenv/bin:$PATH nohup bundle exec sidekiq -e production -i 1 -P tmp/pids/sidekiq.pid-1 >> log/sidekiq.log 2>&1 &'" as uid app_user and gid app_group with timeout 90 seconds

ololo-psh / puma.sh

Created October 19, 2015 01:50 — forked from runlevel5/puma.sh

pumactl is very broken, @nemshilov and @joneslee85 wrote this bash script replacement and it works so reliably on production server. So here it is, share with the world!

	#!/usr/bin/env bash

	# Simple move this file into your Rails `script` folder. Also make sure you `chmod +x puma.sh`.
	# Please modify the CONSTANT variables to fit your configurations.

	# The script will start with config set by $PUMA_CONFIG_FILE by default

	PUMA_CONFIG_FILE=config/puma.rb
	PUMA_PID_FILE=tmp/pids/puma.pid
	PUMA_SOCKET=tmp/sockets/puma.sock

ololo-psh / localhost.conf

Created October 18, 2015 21:28 — forked from jtadeulopes/localhost.conf

Default nginx server

	upstream project {
	server unix:///var/tmp/project.sock;
	}

	server {
	listen 80;
	server_name localhost;

	root /var/www/project/current/public;

ololo-psh / nginx.conf

Created October 18, 2015 21:25 — forked from plentz/nginx.conf

Best nginx configuration for improved security(and performance). Complete blog post here http://tautt.com/best-nginx-configuration-for-security/

	# to generate your dhparam.pem file, run in the terminal
	openssl dhparam -out /etc/nginx/ssl/dhparam.pem 2048

ololo-psh / server.md

Created October 18, 2015 20:57 — forked from jtadeulopes/server.md

Server setup with ubuntu, nginx and puma for rails app.

Update and upgrade the system

sudo apt-get update
sudo apt-get upgrade
sudo apt-get dist-upgrade
sudo apt-get autoremove
sudo reboot

ololo-psh / capybara cheat sheet

Last active August 29, 2015 14:27 — forked from zhengjia/capybara cheat sheet

capybara cheat sheet

	=Navigating=
	visit('/projects')
	visit(post_comments_path(post))

	=Clicking links and buttons=
	click_link('id-of-link')
	click_link('Link Text')
	click_button('Save')
	click('Link Text') # Click either a link or a button
	click('Button Value')

ololo-psh / gist:549d37b79d0439830b1f

Last active August 29, 2015 14:17

ng-material-dumb

	<html lang="en" ng-app="StarterApp">
	<head>
	<link rel="stylesheet" href="https://ajax.googleapis.com/ajax/libs/angular_material/0.8.3/angular-material.min.css">
	<link rel="stylesheet" href="https://fonts.googleapis.com/css?family=RobotoDraft:300,400,500,700,400italic">
	<meta name="viewport" content="initial-scale=1, maximum-scale=1" />
	</head>
	<body layout="column" ng-controller="AppCtrl">
	<md-toolbar layout="row">
	<button ng-click="toggleSidenav('left')" hide-gt-sm class="menuBtn">
	<span class="visually-hidden">Menu</span>

ololo-psh / bench_rails_memory_usage.rb

Last active August 29, 2015 14:17 — forked from brianhempel/bench_rails_memory_usage.rb

	require "net/http"

	def start_server
	# Remove the X to enable the parameters for tuning.
	# These are the default values as of Ruby 2.2.0.
	@child = spawn(<<-EOC.split.join(" "))
	XRUBY_GC_HEAP_FREE_SLOTS=4096
	XRUBY_GC_HEAP_INIT_SLOTS=10000
	XRUBY_GC_HEAP_GROWTH_FACTOR=1.8
	XRUBY_GC_HEAP_GROWTH_MAX_SLOTS=0

Decadent Gingerbread ololo-psh

Update and upgrade the system