更新: | 2012-12-17 |
---|---|
バージョン: | 0.0.1 |
作者: | @voluntas |
URL: | http://voluntas.github.com/ |
/* | |
Copyright 2012 Twitter, Inc. | |
Licensed under the Apache License, Version 2.0 (the "License"); | |
you may not use this file except in compliance with the License. | |
You may obtain a copy of the License at | |
http://www.apache.org/licenses/LICENSE-2.0 | |
Unless required by applicable law or agreed to in writing, software |
ソースコードとかはここ | |
https://github.com/voluntas/snowflake/tree/feature/json | |
jiffy .. Time: 342740 | |
ejson .. Time: 428936 | |
mochijson2 .. Time: 8359019 | |
jsx .. Time: 2124705 | |
jsonx .. Time: 116367 | |
simplejson: 3.1.2 |
# This only works with the current master branch of Akka | |
# Setup the necessary deps | |
brew install python | |
# adjust this depending on the latest version of Python that brew installed | |
export PATH=`brew --prefix python`/bin:/usr/local/share/python:$PATH | |
pip install sphinx |
{sys, [ | |
{lib_dirs, ["../deps"]}, %% depsを追加 | |
{erts, [{mod_cond, derived}, {app_file, strip}]}, | |
{app_file, strip}, | |
{rel, "hogeapplication", "0.1", | |
[ | |
%% 標準で使うライブラリも全て追加 | |
kernel, | |
stdlib, | |
sasl, |
原題:Dynamo: Amazon’s Highly Available Key-value Store
原文: Amazon's Dynamo - All Things Distributed (PDF Version)
This article is translated by @ono_matope. Please contact me if any problem.
#!/usr/bin/ruby | |
require 'find' | |
require 'fileutils' | |
dir = ARGV.shift | |
Find.find(dir) do |f| | |
if File.file?(f) and /20111123.*\.xls$/ =~ f | |
FileUtils.mv(f, f.sub(/20111123/, '20111124'), { :noop => false, :verbose => true }) |
Your API does REST, but can it SLEEP?
SLEEP (Syncable Lightweight Event Emitting Persistence) is an emerging standard for distributed data sync using HTTP and JSON. A generalized version of CouchDB's much lauded built-in replication, SLEEP extends the REST architecture to define a way in which databases can offer syncable JSON APIs that foster open data innovation by allowing developers to replicate entire databases over the net.
SLEEP comes from the Apache CouchDB project which is now widely known for it's multi-master streaming HTTP + JSON replication. This is possible in part because of the CouchDB _changes feed, which is a particular API that lets you see if there have been any changes made to the database since last time you synchronized. CouchDB can efficiently implement the _changes feed because of one subtle difference between it and most other databases: it stores a history of all changes that happen to the database, including deletes.
If you synchronize data from a remote source and then the
package forma; | |
import forma.WholeFileInputFormat; | |
import cascading.scheme.Scheme; | |
import cascading.tap.Tap; | |
import cascading.tuple.Fields; | |
import cascading.tuple.Tuple; | |
import cascading.tuple.TupleEntry; | |
import java.io.IOException; | |
import org.apache.hadoop.mapred.JobConf; |