osiloke’s gists

osiloke / gist:1138798

Created August 11, 2011 02:38 — forked from saidimu/gist:1024207

Generating URLs to crawl from outside a Scrapy spider

	from scrapy import log
	from scrapy.item import Item
	from scrapy.http import Request
	from scrapy.contrib.spiders import XMLFeedSpider


	def NextURL():
	"""
	Generate a list of URLs to crawl. You can query a database or come up with some other means
	Note that if you generate URLs to crawl from a scraped URL then you're better of using a

osiloke / extractors.py

Created August 12, 2011 14:27 — forked from davepeck/extractors.py

A scrapy link extractor that uses BeautifulSoup

	import re

	from scrapy.link import Link
	from urlparse import urljoin
	from BeautifulSoup import BeautifulSoup

	class SoupLinkExtractor(object):
	def __init__(self, args, *kwargs):
	super(SoupLinkExtractor, self).__init__()
	allow_re = kwargs.get('allow', None)

osiloke / transfer-network-config

Created September 30, 2011 15:18 — forked from makuk66/transfer-network-config

Notes about using point-to-point links for routing IP addresses in virtual machines

	Some experiments, which worked but were eventually not used.
	See http://www.greenhills.co.uk/2011/06/10/lxc.html

	Now, the next big milestone is to get networking working.
	In the config, we told lxc-create to use br0 as the link,
	and inside the container we have eth0:

	root@thunder:/# brctl show br0
	bridge name bridge id STP enabled interfaces
	br0 8000.962e6bb72480 no vethP70LNx

osiloke / lxc.rb

Created October 3, 2011 20:23 — forked from niklas/lxc.rb

Setup an lxc-container (chef recipe)

	package 'debootstrap'
	package 'apt-cacher-ng'
	package 'inotify-tools'

	include_recipe 'lxc::manage'
	include_recipe 'lxc::network_bridge'
	include_recipe 'lxc::dns'

	host = node[:container]

osiloke / native.scroll.html

Created October 22, 2012 17:25 — forked from mattsahr/native.scroll.html

IOS Webkit - native internal scroll - a fix for the document page-top-bounce

	<!DOCTYPE html>
	<html>
	<!-- NOTES
	Demo - uses IOS native scroll available in IOS5, but sidestep the document-bounce behavior. Tested on iPad 1, using IOS 5.1.

	This approach uses a set of 3 nested divs.
	OuterDiv -- fixed height, width, overflow-scrolling: touch;
	MiddleDiv -- fixed height width, overflow-scrolling: touch; fits inside OuterDiv
	InnerDiv -- fixed height width, bigger than MiddleDiv, so it kicks in the overflow behavior

osiloke / default.rb

Created June 12, 2013 23:41 — forked from tzusman/default.rb

	#
	# Cookbook Name:: s3_backups
	# Recipe:: default
	# Author:: Todd Zusman (toddzusman.com)
	#

	execute "apt-get update" do
	action :nothing
	end

osiloke / nginx_cors_s3_upload_proxy_full

Created June 25, 2013 15:20 — forked from zefer/nginx_cors_s3_upload_proxy_full

	# DO NOT RESPOND TO REQUESTS OTHER THAN yourdomain.com
	server {
	listen 80 default;
	server_name _;
	return 444;
	}

	# FILE UPLOADS
	server {
	listen 80;

osiloke / libdnet_python.rb

Created June 29, 2013 15:56 — forked from benhagen/libdnet_python.rb

	require 'formula'

	class LibdnetPython <Formula
	depends_on 'libdnet'
	url 'http://libdnet.googlecode.com/files/libdnet-1.12.tgz'
	homepage 'http://code.google.com/p/libdnet/'
	sha1 '71302be302e84fc19b559e811951b5d600d976f8'

	def install
	ENV["CFLAGS"] = "-O3 -w -pipe"

osiloke / ActionBarExample.java

Created July 24, 2013 00:34 — forked from mwheeler/ActionBarExample.java

	// Copyright (C) 2013 Polychrom Pty Ltd
	//
	// This program is licensed under the 3-clause "Modified" BSD license,
	// see LICENSE file for full definition.

	package com.polychrom.examples;

	import java.util.concurrent.ExecutorService;

	import android.app.Activity;

osiloke / txredns.py

Created July 27, 2013 23:37 — forked from fcoury/txredns.py

	# Python/Twisted/Redis backed DNS server - resolves from NAME to IP addrs
	# fallback to google or any other DNS server to resolv domains not present on Redis
	# to set a new domain on redis, just issue a SET domain.tld ip_addr
	# run with twistd -ny txredns.tac
	# gleicon 2011

	from twisted.names import dns, server, client, cache
	from twisted.application import service, internet
	from twisted.internet import defer
	from twisted.python import log

Osi Emoekpere osiloke