Brian Sparrow bsparrow435

#Riak Multi DC Repl Cheat Sheet

##Types There are two types of multi data center replication in Riak.

Fullsync

Operation is triggered by connection creation between clusters, running riak-repl start-fullsync on the listener leader, or every fullsync_interval minutes. Relevant app.config settings:

#Add to vm.args

## Increase number of concurrent ports/sockets
-env ERL_MAX_PORTS 65536

## Use more Erlang processes (128K rather than default of 64K)
+P 131072

## Use a larger distributed erlang message buffer size to avoid (most) disterl busy port issues

[root@d-kvs-01 riak]# riak version 
Attempting to restart script through sudo -H -u riak 
riak-ee (1.2.0-92bc3fa0 2012-08-27) RedHat x86_64 
[root@d-kvs-01 ~]# riak-admin cluster leave 
Attempting to restart script through sudo -H -u riak 
Success: staged leave request for '[email protected]' 
[root@d-kvs-01 ~]# riak-admin cluster plan 
Attempting to restart script through sudo -H -u riak 
=============================== Staged Changes ================================



2012-08-24 00:24:20.747 [error] emulator Error in process <0.24573.185> on node '[email protected]' with exit value: {badarg,[{erlang,binary_to_term,[<<30438 bytes>>],[]},{mi_segment,iterate_all_bytes,2,[{file,"src/mi_segment.erl"},{line,164}]},{mi_server,'-group_iterator/2-fun-1-',2,[{file,"src/mi_server.erl"},{line,723}]},{mi_server,'-group_iterator/2-fun-0-'... 


2012-08-24 00:24:20.747 [error] <0.1057.0>@mi_scheduler:worker_loop:141 Failed to compact <0.4184.0>: {badarg,[{erlang,binary_to_term,[<<131,109,0,0,246,224,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,6

`2012-08-24 00:24:20.747 [error] emulator Error in process <0.24573.185> on node '[email protected]' with exit value: {badarg,[{erlang,binary_to_term,[<<30438 bytes>>],[]},{mi_segment,iterate_all_bytes,2,[{file,"src/mi_segment.erl"},{line,164}]},{mi_server,'-group_iterator/2-fun-1-',2,[{file,"src/mi_server.erl"},{line,723}]},{mi_server,'-group_iterator/2-fun-0-'...

2012-08-24 00:24:20.747 [error] <0.1057.0>@mi_scheduler:worker_loop:141 Failed to compact <0.4184.0>: {badarg,[{erlang,binary_to_term,[<<131,109,0,0,246,224,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,61,

#How To: Clone A Cluster

##Summary This gist will walk through the procedure of altering a secondary cluster using the ring configuration of a primary cluster. This configuration allows partitions to be transferred between clusters using any file transfer utility.

##Restrictions

Supported Riak Versions: 1.2
Both clusters must have same ring size and node count.

#How To: Clone A Cluster

##Summary This gist will walk through the procedure of altering a secondary cluster using the ring configuration of a primary cluster. This configuration allows partitions to be transferred between clusters using any file transfer utility.

##Restrictions

Supported Riak Versions: 1.2
Both clusters must have same ring size and node count.

	#!/usr/bin/env escript
	%% -- erlang --

	-include_lib("kernel/include/file.hrl").
	-compile(export_all).
	-define(LOG(S), io:format(S)).
	-define(LOG(S,A), io:format(S,A)).

	main(Dirs) ->
	CodePath = case os:getenv("RIAK_LIB") of

	REPO ?= riak

	.PHONY: rel stagedevrel deps

	all: deps compile

	compile:
	./rebar compile

	deps:

	```
	2012-08-30 22:04:01.135 [info] <0.22219.0>@riak_core_handoff_sender:start_fold:126 Starting ownership_handoff transfer of riak_kv_vnode from '[email protected]' 11417981541647679048466287755595961091061972992 to '[email protected]' 11417981541647679048466287755595961091061972992
	2012-08-30 22:04:03.658 [info] <0.198.0>@riak_core_handoff_manager:handle_info:271 An outbound handoff of partition riak_kv_vnode 0 was terminated for reason: {shutdown,max_concurrency}
	2012-08-30 22:04:10.079 [info] <0.22254.0>@riak_core_handoff_sender:start_fold:126 Starting ownership_handoff transfer of riak_kv_vnode from '[email protected]' 0 to '[email protected]' 0
	2012-08-30 22:04:32.449 [error] <0.1729.0> gen_fsm <0.1729.0> in state active terminated with reason: {timeout,{gen_server,call,[riak_core_handoff_manager,{add_outbound,riak_kv_vnode,11417981541647679048466287755595961091061972992,'[email protected]',<0.1729.0>}]}}
	2012-08-30 22:04:36.755 [error] <0.1729.0> CRASH REPORT