Sam Millar millar

On Tue Oct 27, 2015, history.state.gov began buckling under load, intermittently issuing 500 errors. Nginx's error log was sprinkled with the following errors:

2015/10/27 21:48:36 [crit] 2475#0: accept4() failed (24: Too many open files)

2015/10/27 21:48:36 [alert] 2475#0: *7163915 socket() failed (24: Too many open files) while connecting to upstream...

An article at http://www.cyberciti.biz/faq/linux-unix-nginx-too-many-open-files/ provided directions that mostly worked. Below are the steps we followed. The steps that diverged from the article's directions are marked with an *.

* Instead of using su to run ulimit on the nginx account, use ps aux | grep nginx to locate nginx's process IDs. Then query each process's file handle limits using cat /proc/pid/limits (where pid is the process id retrieved from ps). (Note: sudo may be necessary on your system for the cat command here, depending on your system.)
Added fs.file-max = 70000 to /etc/sysctl.conf

the default index.html does not work well in prodution mode, so do not borther to config that, just delete it and go on.

To put things in production mode, do

 rails g scaffold items name:string
 rake db:migrate RAILS_ENV=production
 rm public/index.html
 #change route.rb point root to items#index
 rake assets:precompile
 sudo service nginx restart

./config/unicorn_init.sh stop

Rails 3.0.pre on App Engine¶ ↑

You can Rails 3 on App Engine, but it won’t be especially useful until bundler 10. You should try these instead:

Rails 2.3.5: DataMapper version: gist.github.com/268192
Rails 2.3.5: TinyDS version: gist.github.com/269075

Install the Development Environment¶ ↑

The gems for the development environment include a pre-release appengine-tools gem that provides a pre-release version of jruby-rack.

	import urllib2
	import re
	import sys
	from collections import defaultdict
	from random import random

	"""
	PLEASE DO NOT RUN THIS QUOTED CODE FOR THE SAKE OF daemonology's SERVER, IT IS
	NOT MY SERVER AND I FEEL BAD FOR ABUSING IT. JUST GET THE RESULTS OF THE
	CRAWL HERE: http://pastebin.com/raw.php?i=nqpsnTtW AND SAVE THEM TO "archive.txt"