Skip to content

Instantly share code, notes, and snippets.

######## setting up control node:
sudo -s
yum -y install erlang R git make gcc gcc-c++ glibc-devel R-devel python-argparse
git clone git://github.com/basho/basho_bench.git /opt/basho_bench
export HOME=/root
cd /opt/basho_bench
make all
sed -i 's,#!/usr/bin/env Rscript --vanilla,#!/usr/bin/Rscript --vanilla,g' priv/summary.r
git clone git://github.com/drewkerrigan/riak_benchmarking.git /opt/riak_benchmarking
Baseline Tests
HTTP / Bitcask (done, although could be redone since we used rc2 instead of rc3)
Protobuf / Bitcask (done, although could be redone since we used rc2 instead of rc3)
HTTP / LevelDB (done, although could be redone since we used rc2 instead of rc3)
Protobuf / LevelDB (done, although could be redone since we used rc2 instead of rc3)
Functionality Tests
2i / Protobuf / LevelDB
Plain 2 hour (done, although could be redone since we used rc2 instead of rc3)
Plain 24-48 hour (in progress)
On top of a baseline (not done)
basho-ninja:mhealth dkerrigan$ git log origin/pre-prod-deploy-2-6-2013..HEAD
commit f51a8ab96dc56b53a01c8bf89f414364c706df10
Author: drewkerrigan <[email protected]>
Date: Thu Jan 17 12:06:35 2013 -0500
fixing from/to bug in metrics report
commit 5b4e55535553b2d4dd08b14c881472b8518e3339
Author: drewkerrigan <[email protected]>
Date: Wed Jan 16 15:49:08 2013 -0500
@drewkerrigan
drewkerrigan / newrelic_install_instructions.txt
Created January 29, 2013 20:58
Newrelic Install Instructions
1) Add the New Relic yum repository
Install the newrelic-repo package, which configures a new package repository for yum:
#########################################
rpm -Uvh http://download.newrelic.com/pub/newrelic/el5/i386/newrelic-repo-5-3.noarch.rpm
#########################################
2) Install the Server Monitor package
Run the install command:
basho-ninja:riak-data-migrator dkerrigan$ mvn package
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Riak Data Migrator 0.1
[INFO] ------------------------------------------------------------------------
Downloading: http://repo1.maven.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/2.7.2/maven-surefire-plugin-2.7.2.pom
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/2.7.2/maven-surefire-plugin-2.7.2.pom (10 KB at 18.9 KB/sec)
Downloading: http://repo1.maven.org/maven2/org/apache/maven/surefire/surefire/2.7.2/surefire-2.7.2.pom
Downloaded: http://repo1.maven.org/maven2/org/apache/maven/surefire/surefire/2.7.2/surefire-2.7.2.pom (11 KB at 154.6 KB/sec)
@drewkerrigan
drewkerrigan / gist:4218222
Created December 5, 2012 18:31
php multi-get mapred
require("riak-php-client/riak.php");
$client = new RiakClient('127.0.0.1', 8098);
$mr = new RiakMapReduce($client);
$keys = array("TFrWAVz8RRVEEqCH3nS27O4InLB","FEwZgNI4VTJSIZxSas0QpOCCXjn","EkSkmblyIAT5VL7xYpScP2GP71G");
foreach ($keys as $key) {
$mr->add("local_ns~users", $key);
}
$mr->map("Riak.mapValues");
@drewkerrigan
drewkerrigan / gist:4199310
Created December 4, 2012 00:18
multi node riak install notes
############### Testing Node install.sh
cd
sudo apt-get install git make build-essential libncurses5-dev openssl libssl-dev
git clone git://github.com/basho/basho_bench.git
cd basho_bench
cp examples/riakc_pb.config azure_riakc_pb.config
cd
############### Node 1-N install.sh
cd
@drewkerrigan
drewkerrigan / gist:4197417
Created December 3, 2012 19:43
usage metrics notes
basho-ninja:mhealth dkerrigan$ RACK_ENV=local ; ./console
1.9.3p194 :001 > a = Application.find("api-tester-client")
=> <Application:api-tester-client flags={} created_at=2012-11-30 16:39:40 UTC app_type="client" app_status="prod" scope_permissions="public" connected_apps=0 total_users=0 has_icon=false name="api-tester-client" display_name="API Tester Client" developer_id="FEwZgNI4VTJSIZxSas0QpOCCXjn" description="Qui corporis labore enim voluptatem non numquam ducimus maiores." compliance="fda" url_callback="http://localhost" default_access_type="read" consumer_id="VuLWp8shXiLxh7Tn7hSf" consumer_secret="046IpUI5KhZ2m1QQllWrx9AbrVIhtXVGQyEM18Ec" updated_at=2012-11-30 16:39:40 UTC url_website=nil organization=nil url_support=nil url_subscription=nil>
1.9.3p194 :002 > a.metrics_totals
=> {:storage_used=>6266.0, :api_usage=>14919.0, :api_calls=>40, :third_party_api_calls=>4714.0}
1.9.3p194 :003 > a.metrics_details("20121115","20121215")
=> {:storage_used=>{"20121115"=>0.0, "20121116"=>0.0, "20121117"=>0.0,
@drewkerrigan
drewkerrigan / gist:4171112
Created November 29, 2012 18:56
splatted report endpoint
get "/admin/reports/*_metrics.csv" do |operation|
endpoint = Att::API::Internal::Metrics.new(Server.setting(:api_uri), @app, @type)
report = "Date of Report,"
report += "Developer Registration Date,"
report += "Developer Id,"
report += "Developer Email,"
report += "Developer Organization,"
report += "Developer CTN,"
report += "AT&T Wireless Customer,"
@drewkerrigan
drewkerrigan / gist:4149773
Created November 26, 2012 18:26
bundle exec rake results
basho-ninja:api-server dkerrigan$ bundle exec rake
/Users/dkerrigan/.rvm/rubies/ruby-1.9.3-p194/bin/ruby -I"lib:lib:test" -I"/Users/dkerrigan/.rvm/gems/ruby-1.9.3-p194@api_server/gems/rake-0.9.2/lib" "/Users/dkerrigan/.rvm/gems/ruby-1.9.3-p194@api_server/gems/rake-0.9.2/lib/rake/rake_test_loader.rb" "test/**/test_*.rb"
/Users/dkerrigan/.rvm/gems/ruby-1.9.3-p194@api_server/gems/activesupport-3.1.1/lib/active_support/dependencies.rb:240:in `block in require': iconv will be deprecated in the future, use String#encode instead.
:public is no longer used to avoid overloading Module#public, use :public_folder instead
from /Users/dkerrigan/.rvm/gems/ruby-1.9.3-p194@api_server/gems/cans-0.2.2/lib/cans/application.rb:4:in `<class:Application>'
* DEFERRED: for ownerships with an existing ownership specific id with a provider token the /v3/ownership/:id/subscription endpoint should return metadata about existing subscriptions on GET.
* DEFERRED: for ownerships with an existing ownership specific id with a provider