Skip to content

Instantly share code, notes, and snippets.

@toddlipcon
Created December 10, 2010 19:41
Show Gist options
  • Save toddlipcon/736687 to your computer and use it in GitHub Desktop.
Save toddlipcon/736687 to your computer and use it in GitHub Desktop.
10/12/10 11:41:27 DEBUG zookeeper.ZKUtil: hconnection opening connection to ZooKeeper with ensemble (haus01.sf.cloudera.com:2222)
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:host.name=haus01.sf.cloudera.com
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_20
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.home=/mnt/toolchain/JDK6u20-64bit/jre
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/home/todd/haus-cluster/hbase-normal-conf:/mnt/toolchain/JDK6u20-64bit/lib/tools.jar:/home/todd/.m2/repository/ant/ant/1.6.5/ant-1.6.5.jar:/home/todd/.m2/repository/asm/asm/3.1/asm-3.1.jar:/home/todd/.m2/repository/com/cloudera/hadoop/hadoop-core/0.20.2-737/hadoop-core-0.20.2-737.jar:/home/todd/.m2/repository/com/cloudera/hadoop/hadoop-test/0.20.2-737/hadoop-test-0.20.2-737.jar:/home/todd/.m2/repository/com/google/guava/guava/r06/guava-r06.jar:/home/todd/.m2/repository/com/google/protobuf/protobuf-java/2.3.0/protobuf-java-2.3.0.jar:/home/todd/.m2/repository/com/sun/jersey/jersey-core/1.4/jersey-core-1.4.jar:/home/todd/.m2/repository/com/sun/jersey/jersey-json/1.4/jersey-json-1.4.jar:/home/todd/.m2/repository/com/sun/jersey/jersey-server/1.4/jersey-server-1.4.jar:/home/todd/.m2/repository/com/sun/xml/bind/jaxb-impl/2.1.12/jaxb-impl-2.1.12.jar:/home/todd/.m2/repository/com/thoughtworks/paranamer/paranamer/2.2/paranamer-2.2.jar:/home/todd/.m2/repository/com/thoughtworks/paranamer/paranamer-ant/2.2/paranamer-ant-2.2.jar:/home/todd/.m2/repository/com/thoughtworks/paranamer/paranamer-generator/2.2/paranamer-generator-2.2.jar:/home/todd/.m2/repository/com/thoughtworks/qdox/qdox/1.10.1/qdox-1.10.1.jar:/home/todd/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/todd/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar:/home/todd/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/home/todd/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/todd/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar:/home/todd/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar:/home/todd/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar:/home/todd/.m2/repository/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar:/home/todd/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/home/todd/.m2/repository/javax/ws/rs/jsr311-api/1.1.1/jsr311-api-1.1.1.jar:/home/todd/.m2/repository/javax/xml/bind/jaxb-api/2.1/jaxb-api-2.1.jar:/home/todd/.m2/repository/jline/jline/0.9.94/jline-0.9.94.jar:/home/todd/.m2/repository/junit/junit/4.8.1/junit-4.8.1.jar:/home/todd/.m2/repository/log4j/log4j/1.2.16/log4j-1.2.16.jar:/home/todd/.m2/repository/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar:/home/todd/.m2/repository/net/sf/kosmosfs/kfs/0.3/kfs-0.3.jar:/home/todd/.m2/repository/org/apache/ant/ant/1.7.1/ant-1.7.1.jar:/home/todd/.m2/repository/org/apache/ant/ant-launcher/1.7.1/ant-launcher-1.7.1.jar:/home/todd/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar:/home/todd/.m2/repository/org/apache/ftpserver/ftplet-api/1.0.0/ftplet-api-1.0.0.jar:/home/todd/.m2/repository/org/apache/ftpserver/ftpserver-core/1.0.0/ftpserver-core-1.0.0.jar:/home/todd/.m2/repository/org/apache/ftpserver/ftpserver-deprecated/1.0.0-M2/ftpserver-deprecated-1.0.0-M2.jar:/home/todd/.m2/repository/org/apache/hadoop/avro/1.3.3/avro-1.3.3.jar:/home/todd/.m2/repository/org/apache/mina/mina-core/2.0.0-M5/mina-core-2.0.0-M5.jar:/home/todd/.m2/repository/org/apache/thrift/thrift/0.2.0/thrift-0.2.0.jar:/home/todd/.m2/repository/org/apache/zookeeper/zookeeper/3.3.2/zookeeper-3.3.2.jar:/home/todd/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.5.5/jackson-core-asl-1.5.5.jar:/home/todd/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.5.5/jackson-jaxrs-1.5.5.jar:/home/todd/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.4.2/jackson-mapper-asl-1.4.2.jar:/home/todd/.m2/repository/org/codehaus/jackson/jackson-xc/1.5.5/jackson-xc-1.5.5.jar:/home/todd/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home/todd/.m2/repository/org/eclipse/jdt/core/3.1.1/core-3.1.1.jar:/home/todd/.m2/repository/org/jruby/jruby-complete/1.5.2/jruby-complete-1.5.2.jar:/home/todd/.m2/repository/org/mockito/mockito-all/1.8.5/mockito-all-1.8.5.jar:/home/todd/.m2/repository/org/mortbay/jetty/jetty/6.1.25/jetty-6.1.25.jar:/home/todd/.m2/repository/org/mortbay/jetty/jetty-util/6.1.25/jetty-util-6.1.25.jar:/home/todd/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar:/home/todd/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar:/home/todd/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar:/home/todd/.m2/repository/org/slf4j/slf4j-api/1.5.8/slf4j-api-1.5.8.jar:/home/todd/.m2/repository/org/slf4j/slf4j-log4j12/1.5.8/slf4j-log4j12-1.5.8.jar:/home/todd/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/todd/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/home/todd/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/home/todd/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/home/todd/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/todd/haus-cluster/hbase/target/classes:/home/todd/haus-cluster/hbase/target/test-classes:/home/todd/haus-cluster/hbase/target:/home/todd/haus-cluster/hbase/lib/*.jar::/home/todd/hadoop-lzo/build/hadoop-lzo-0.4.4.jar
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/home/todd/hadoop-lzo/build//native/Linux-amd64-64/lib
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.18-194.11.1.el5
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:user.name=todd
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/todd
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/todd/haus-cluster/hbase
10/12/10 11:41:27 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=haus01.sf.cloudera.com:2222 sessionTimeout=60000 watcher=hconnection
10/12/10 11:41:27 INFO zookeeper.ClientCnxn: Opening socket connection to server haus01.sf.cloudera.com/172.29.5.32:2222
10/12/10 11:41:27 INFO zookeeper.ClientCnxn: Socket connection established to haus01.sf.cloudera.com/172.29.5.32:2222, initiating session
10/12/10 11:41:27 INFO zookeeper.ClientCnxn: Session establishment complete on server haus01.sf.cloudera.com/172.29.5.32:2222, sessionid = 0x12c780205200075, negotiated timeout = 60000
10/12/10 11:41:27 DEBUG zookeeper.ZooKeeperWatcher: hconnection Received ZooKeeper Event, type=None, state=SyncConnected, path=null
10/12/10 11:41:27 DEBUG zookeeper.ZooKeeperWatcher: hconnection-0x12c780205200075 connected
10/12/10 11:41:27 DEBUG zookeeper.ZKUtil: hconnection-0x12c780205200075 Set watcher on existing znode /hbase/master
10/12/10 11:41:27 DEBUG zookeeper.ZKUtil: hconnection-0x12c780205200075 Retrieved 28 byte(s) of data from znode /hbase/master and set watcher; haus01.sf.cloudera.com:60000
10/12/10 11:41:27 DEBUG zookeeper.ZKUtil: hconnection-0x12c780205200075 Set watcher on existing znode /hbase/root-region-server
10/12/10 11:41:27 DEBUG zookeeper.ZKUtil: hconnection-0x12c780205200075 Retrieved 28 byte(s) of data from znode /hbase/root-region-server and set watcher; haus04.sf.cloudera.com:60020
Version: 0.90.0
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Lookedup root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@3d3e58d4; hsa=haus04.sf.cloudera.com:60020
10/12/10 11:41:28 DEBUG client.MetaScanner: Scanning -ROOT- starting at row= for max=2147483647 rows
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Lookedup root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@3d3e58d4; hsa=haus04.sf.cloudera.com:60020
10/12/10 11:41:28 DEBUG client.MetaScanner: Scanning .META. starting at row= for max=2147483647 rows
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Lookedup root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@3d3e58d4; hsa=haus04.sf.cloudera.com:60020
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Cached location for .META.,,1.1028785192 is haus01.sf.cloudera.com:60020
Number of Tables: 1
Number of live region servers: 5
Number of dead region servers: 0
Number of empty REGIONINFO_QUALIFIER rows in .META.: 0
ERROR: Region usertable,user876353700,1291843173343.182d193c6317cab6486eab93bf95b6a7. not deployed on any region server.
Trying to fix unassigned region...
Region being cleared in master: REGION => {NAME => 'usertable,user876353700,1291843173343.182d193c6317cab6486eab93bf95b6a7.', STARTKEY => 'user876353700', ENDKEY => 'user938001635', ENCODED => 182d193c6317cab6486eab93bf95b6a7, TABLE => {{NAME => 'usertable', DEFERRED_LOG_FLUSH => 'true', FAMILIES => [{NAME => 'test', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
Master protocol version: 27
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Cache hit for row <> in tableName .META.: location server haus01.sf.cloudera.com:60020, location region name .META.,,1.1028785192
ERROR: Region usertable,user1471251781,1291843165326.af66c1c6ff9b72a4ac293d44e6c8ef58. not deployed on any region server.
Trying to fix unassigned region...
Region being cleared in master: REGION => {NAME => 'usertable,user1471251781,1291843165326.af66c1c6ff9b72a4ac293d44e6c8ef58.', STARTKEY => 'user1471251781', ENDKEY => 'user1531018324', ENCODED => af66c1c6ff9b72a4ac293d44e6c8ef58, TABLE => {{NAME => 'usertable', DEFERRED_LOG_FLUSH => 'true', FAMILIES => [{NAME => 'test', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
Master protocol version: 27
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Cache hit for row <> in tableName .META.: location server haus01.sf.cloudera.com:60020, location region name .META.,,1.1028785192
ERROR: Found inconsistency in table usertable
Summary:
-ROOT- is okay.
Number of regions: 1
Deployed on: haus04.sf.cloudera.com:60020
.META. is okay.
Number of regions: 1
Deployed on: haus01.sf.cloudera.com:60020
Table usertable is inconsistent.
Number of regions: 30
Deployed on: haus01.sf.cloudera.com:60020 haus03.sf.cloudera.com:60020 haus04.sf.cloudera.com:60020
3 inconsistencies detected.
Status: INCONSISTENT
Version: 0.90.0
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Lookedup root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@3d3e58d4; hsa=haus04.sf.cloudera.com:60020
10/12/10 11:41:28 DEBUG client.MetaScanner: Scanning -ROOT- starting at row= for max=2147483647 rows
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Lookedup root region location, connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@3d3e58d4; hsa=haus04.sf.cloudera.com:60020
10/12/10 11:41:28 DEBUG client.MetaScanner: Scanning .META. starting at row= for max=2147483647 rows
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Cache hit for row <> in tableName .META.: location server haus01.sf.cloudera.com:60020, location region name .META.,,1.1028785192
Number of Tables: 1
Number of live region servers: 5
Number of dead region servers: 0
Number of empty REGIONINFO_QUALIFIER rows in .META.: 0
ERROR: Region usertable,user876353700,1291843173343.182d193c6317cab6486eab93bf95b6a7. not deployed on any region server.
Trying to fix unassigned region...
Region being cleared in master: REGION => {NAME => 'usertable,user876353700,1291843173343.182d193c6317cab6486eab93bf95b6a7.', STARTKEY => 'user876353700', ENDKEY => 'user938001635', ENCODED => 182d193c6317cab6486eab93bf95b6a7, TABLE => {{NAME => 'usertable', DEFERRED_LOG_FLUSH => 'true', FAMILIES => [{NAME => 'test', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
Master protocol version: 27
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Cache hit for row <> in tableName .META.: location server haus01.sf.cloudera.com:60020, location region name .META.,,1.1028785192
ERROR: Region usertable,user1471251781,1291843165326.af66c1c6ff9b72a4ac293d44e6c8ef58. not deployed on any region server.
Trying to fix unassigned region...
Region being cleared in master: REGION => {NAME => 'usertable,user1471251781,1291843165326.af66c1c6ff9b72a4ac293d44e6c8ef58.', STARTKEY => 'user1471251781', ENDKEY => 'user1531018324', ENCODED => af66c1c6ff9b72a4ac293d44e6c8ef58, TABLE => {{NAME => 'usertable', DEFERRED_LOG_FLUSH => 'true', FAMILIES => [{NAME => 'test', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
Master protocol version: 27
10/12/10 11:41:28 DEBUG client.HConnectionManager$HConnectionImplementation: Cache hit for row <> in tableName .META.: location server haus01.sf.cloudera.com:60020, location region name .META.,,1.1028785192
ERROR: Found inconsistency in table usertable
Summary:
-ROOT- is okay.
Number of regions: 1
Deployed on: haus04.sf.cloudera.com:60020
.META. is okay.
Number of regions: 1
Deployed on: haus01.sf.cloudera.com:60020
Table usertable is inconsistent.
Number of regions: 30
Deployed on: haus01.sf.cloudera.com:60020 haus03.sf.cloudera.com:60020 haus04.sf.cloudera.com:60020
6 inconsistencies detected.
Status: INCONSISTENT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment