Humanismusic humanismusic

What is this?

This little script lets you easily define a few things you want from a web page (using CSS selectors), the crawl the site until you get them all.

It's based on the way Kimono works, but it's much simpler and has no limit to the number of results you can get. It also uses your auth tokens from the browser, so it's just as secure as your browser (which you should still be suspect of).

How do I use it?

Put that script into your browser terminal and run it. If you use Chrome, I highly recommend saving it as a snippet for easy reuse. To start scraping a site, create a Scraper instance with your desired options:

From zero to microservice with 𝚫 now

The following guide will show you how to deploy a simple microservice written in JavaScript using 𝚫 now.

It uses Open Source tools that are widely available, tested and understood:

Node.JS
NPM
Express

Gathering.js - How to use

Keep list (and count) of online users in a Firebase web app - by isolated rooms or globally.

Live Demo

Firebase Shared Checklist is a demo application that shows the number of users joined a checklist using gathering.js. Here is a 1 minute screencast of using this application.

	// Native selectors.
	(function(window, document) {
	'use strict';

	var noop = function() {
	};

	// DOCUMENT LOAD EVENTS
	// not needed at the bottom of the page
	document.addEventListener('DOMContentLoaded', noop);

	var app = angular.module('myapp', ['ionic', 'firebase'])

	app.controller('ctrl', function($scope, $firebaseArray) {

	// create a connection to Firebase
	var baseRef = new Firebase('https://webapi.firebaseio.com/rolodex');
	// create a scrollable reference
	var scrollRef = new Firebase.util.Scroll(baseRef, 'name');

	// create a synchronized array on scope

	'use strict';

	var elasticsearch = require('elasticsearch');
	var Promise = require('bluebird');

	var log = console.log.bind(console);

	var client = new elasticsearch.Client({
	host: 'localhost:9200',
	log: 'trace'

	Scarecrow in the hillock
	Paddy field --
	How unaware! How useful!

	Passing through the world
	Indeed this is just
	Sogi's rain shelter.

	A wild sea-
	In the distance over Sado

	{
	"rules": {

	// REQUIRED FIELDS
	"example1" : {
	"$record": {
	// foo and bar are required fields that must always exist
	// this will reject writes to $record, as well as directly to $record/foo or $record/bar if they are null
	".validate": "newData.hasChildren(['foo', 'bar'])"
	}

	# Stream a video
	ffmpeg -re -i video.avi -vf "scale=40:ih*40/iw, crop=40:16" -f rawvideo -vcodec rawvideo -sws_flags bilinear -pix_fmt rgb24 - > /dev/udp/matelight.cbrp3.c-base.org/1337

	# Loop a gif
	ffmpeg -re -ignore_loop 0 -i image.gif -vf "scale=40:ih*40/iw, crop=40:16" -f rawvideo -vcodec rawvideo -sws_flags bilinear -pix_fmt rgb24 - > /dev/udp/matelight.cbrp3.c-base.org/1337

	# Stream webcam
	# Mac
	ffmpeg -re -f avfoundation -r 30 -s 1280x720 -i "0" -vf "scale=40:ih*40/iw, crop=40:16, pp=autolevels:f, eq=1.5" -f rawvideo -vcodec rawvideo -sws_flags bilinear -pix_fmt rgb24 - > /dev/udp/matelight.cbrp3.c-base.org/1337

	{
	"rules": {
	"users": {
	"$user_id": {
	// email address is required
	".validate": "newData.hasChildren(['email'])",
	}
	},

	"emails_to_users": {