Skip to content

Instantly share code, notes, and snippets.

View wdberkeley's full-sized avatar

William Berkeley wdberkeley

View GitHub Profile
@wdberkeley
wdberkeley / scantoken_noncoveringrange.cc
Created August 16, 2016 17:40
bug with scan token and non-covering range partitions?
#include "kudu/client/client.h"
using namespace std;
using std::string;
using kudu::client::sp::shared_ptr;
using kudu::client::KuduClient;
using kudu::client::KuduClientBuilder;
using kudu::client::KuduColumnSchema;
using kudu::client::KuduInsert;
@wdberkeley
wdberkeley / ksck_out.0.txt
Created May 1, 2017 17:37
KUDU-1860 ksck output example
Connected to the Master
WARNING: Unable to connect to Tablet Server ac2de1a8f62542fcb7a180dc232b1c30 (127.0.0.1:7150): Network error: could not send Ping RPC to server: Client connection negotiation failed: client connection to 127.0.0.1:7150: connect: Connection refused (error 61)
WARNING: Unable to connect to Tablet Server 4414b7f80f4d488eb65e7772759f2bcf (127.0.0.1:7152): Network error: could not send Ping RPC to server: Client connection negotiation failed: client connection to 127.0.0.1:7152: connect: Connection refused (error 61)
WARNING: Fetched info from 1 Tablet Servers, 2 weren't reachable
Tablet 3c5b2090495d4e05ae024c96725f7099 of table 'twitter' is unavailable: 2 replica(s) not RUNNING
9e8acf07e76c468eadaf1903e923a86a (127.0.0.1:7151): RUNNING [LEADER]
4414b7f80f4d488eb65e7772759f2bcf (127.0.0.1:7152): TS unavailable
ac2de1a8f62542fcb7a180dc232b1c30 (127.0.0.1:7150): TS unavailable
WARNING: Some replicas' configs differ from the master's.
@wdberkeley
wdberkeley / ksck_out.1.txt
Created May 1, 2017 17:38
KUDU-1860 output (master says under-replicated but actually unavailable)
Connected to the Master
WARNING: Unable to connect to Tablet Server ac2de1a8f62542fcb7a180dc232b1c30 (127.0.0.1:7150): Network error: could not send Ping RPC to server: Client connection negotiation failed: client connection to 127.0.0.1:7150: connect: Connection refused (error 61)
WARNING: Fetched info from 2 Tablet Servers, 1 weren't reachable
Tablet 3c5b2090495d4e05ae024c96725f7099 of table 'twitter' is under-replicated: 1 replica(s) not RUNNING
9e8acf07e76c468eadaf1903e923a86a (127.0.0.1:7151): RUNNING [LEADER]
4414b7f80f4d488eb65e7772759f2bcf (127.0.0.1:7152): RUNNING
ac2de1a8f62542fcb7a180dc232b1c30 (127.0.0.1:7150): TS unavailable
WARNING: Some replicas' configs differ from the master's.
The master's config is:
WARNING: Fetched info from 2 Tablet Servers, 1 weren't reachable
Tablet 3c5b2090495d4e05ae024c96725f7099 of table 'twitter' is under-replicated: 1 replica(s) not RUNNING
4414b7f80f4d488eb65e7772759f2bcf (127.0.0.1:7152): RUNNING [LEADER]
9e8acf07e76c468eadaf1903e923a86a (127.0.0.1:7151): RUNNING
ac2de1a8f62542fcb7a180dc232b1c30 (127.0.0.1:7150): TS unavailable
All the peers in this configuration are:
A = 4414b7f80f4d488eb65e7772759f2bcf
B = 9e8acf07e76c468eadaf1903e923a86a
C = ac2de1a8f62542fcb7a180dc232b1c30
@wdberkeley
wdberkeley / gist:f964439bb0c407d3769c2dd9a0959ca0
Created May 15, 2017 18:25
ksck output indicative of KUDU-1860
Tablet 8c225529910e4b08998409e3de7c2a4c of table 'tpch1' is under-replicated: 1 replica(s) not RUNNING
355c51762eff46c89497ba35f4cb6519 (127.0.0.1:7152): TS unavailable
524d3572c95d4fcab7517adc0aa35a75 (127.0.0.1:7150): RUNNING [LEADER]
832e141b489e4e71a158b68228a61750 (127.0.0.1:7151): RUNNING
3 replicas' active configs differ from the master's.
All the peers reported by the master and tablet servers are:
A = 355c51762eff46c89497ba35f4cb6519
B = 524d3572c95d4fcab7517adc0aa35a75
C = 832e141b489e4e71a158b68228a61750
3 replicas' active configs differ from the master's.
All the peers reported by the master and tablet servers are:
A = 6761005314e043cc8ed8894e92ad43cd
B = 95fb0b5b212e4f01b0ca9687617a05f3
C = d25a307e128b4383b8606afea9c1a193
The consensus matrix is:
Host Voters Current term Config index Committed?
------------------- -------------------- ------------ ------------ ----------
config from master: A B C* Yes
3 replicas' active configs differ from the master's.
All the peers reported by the master and tablet servers are:
A = 6761005314e043cc8ed8894e92ad43cd
B = 95fb0b5b212e4f01b0ca9687617a05f3
C = d25a307e128b4383b8606afea9c1a193
The consensus matrix is:
Host Voters Current term Config index Committed?
------------------- ------------ ------------ ------------ ----------
config from master: A B C* Yes
$ pwd
/Users/wdberkeley/cdh/kudu
$ thirdparty/build-if-necessary.sh
cat: .build-hash.common: No such file or directory
Rebuilding thirdparty dependency group 'common': the repository has changed since it was last built.
Old git hash:
New build hash: 50c19ce9f4f00bb08d176c947c6c5a8df17ab8fa
cat: .build-hash.uninstrumented: No such file or directory
Rebuilding thirdparty dependency group 'uninstrumented': the repository has changed since it was last built.
Old git hash:
@wdberkeley
wdberkeley / gist:6283a7a7a0c6aee42e7252f120d03ac4
Created December 5, 2017 19:08
Apache Kudu 1.6.0-RC1 TabletCopyClientTest.TestDownloadBlock Failure
[ RUN ] TabletCopyClientTest.TestDownloadBlock
W1205 10:17:49.985105 1999118336 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I1205 10:17:49.985236 1999118336 server_base.cc:229] Could not load existing FS layout: Not found: /private/tmp/kudutest-502/tablet_copy_client-test.TabletCopyClientTest.TestDownloadBlock.1512497869518041-53106/TabletServerTest-fsroot/data-0/instance: No such file or directory (error 2)
I1205 10:17:49.985250 1999118336 server_base.cc:230] Creating new FS layout
I1205 10:17:49.991677 1999118336 fs_manager.cc:567] Generated new instance metadata in path /private/tmp/kudutest-502/tablet_copy_client-test.TabletCopyClientTest.TestDownloadBlock.1512497869518041-53106/TabletServerTest-fsroot/data-0/instance:
uuid: "c0b5ced5c9ca4d75819b8854b477855e"
format_stamp: "Formatted at 2017-12-05 18:17:49 on dhcp-10-16-0-202.pa.cloudera.com"
I1205 10:17:49.991961 1999118336 fs_manager.cc:567]
@wdberkeley
wdberkeley / scaling.adoc
Created December 5, 2017 19:55
Apache Kudu Scaling Doc

Apache Kudu Scaling