loadtable-log

gistfile1.sh

$: hbase org.jruby.Main ../hbase-0.89.20100924/bin/loadtable.rb JacobsMawfuckingTable /tmp/hbase_test/out

                                                                                    
11/01/18 02:43:21 WARN hbase.HBaseConfiguration: instantiating HBaseConfiguration() is deprecated. Please use HBaseConfiguration#create() to construct a plain Configuration
11/01/18 02:43:22 INFO loadtable: Found 1 hfiles
11/01/18 02:43:22 INFO loadtable: 0 read firstkey of 100000031 from hdfs://ip-10-98-71-63.ec2.internal/tmp/hbase_test/out/Magnificent/6133023688808851821
11/01/18 02:43:22 INFO zookeeper.ZooKeeperWrapper: Reconnecting to zookeeper
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.1-942149, built on 05/07/2010 17:14 GMT
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:host.name=ip-10-98-71-63.ec2.internal
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_22
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.22/jre
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/usr/lib/hbase/bin/../conf:/usr/lib/jvm/java-6-sun/jre/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.89.20100924+28.jar:/usr/lib/hbase/bin/../hbase-0.89.20100924+28-tests.jar:/usr/lib/hbase/bin/../hbase.jar:/usr/lib/hbase/bin/../hbase-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/ant-1.6.5.jar:/usr/lib/hbase/bin/../lib/ant-1.7.1.jar:/usr/lib/hbase/bin/../lib/ant-launcher-1.7.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.2.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.2.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r05.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/hsqldb-1.8.0.10.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.1.5.1.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.1.5.1.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.1.5.1.jar:/usr/lib/hbase/bin/../lib/jets3t-0.7.1.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.24.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.24.jar:/usr/lib/hbase/bin/../lib/jline-0.9.94.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.4.0.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.0.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/kfs-0.3.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.15.jar:/usr/lib/hbase/bin/../lib/oro-2.0.8.jar:/usr/lib/hbase/bin/../lib/paranamer-2.2.jar:/usr/lib/hbase/bin/../lib/paranamer-ant-2.2.jar:/usr/lib/hbase/bin/../lib/paranamer-generator-2.2.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/qdox-1.10.1.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.4.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-20081211.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0-2.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/etc/zookeeper:/etc/hadoop-0.20/conf
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/amd64/server:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/lib/amd64:/usr/lib/jvm/java-6-sun-1.6.0.22/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.35-24-virtual
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:user.name=jacob
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/jacob
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/jacob/Programming/hbase_bulkloader
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=10.98.71.63:2181 sessionTimeout=60000 watcher=org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper@52ec1f9e
11/01/18 02:43:22 DEBUG zookeeper.ZooKeeperWrapper: <10.98.71.63:/hbase,org.apache.hadoop.hbase.client.HConnectionManager>Connected to zookeeper again
11/01/18 02:43:22 INFO zookeeper.ClientCnxn: Opening socket connection to server /10.98.71.63:2181
11/01/18 02:43:22 DEBUG zookeeper.ZooKeeperWrapper: <10.98.71.63:/hbase,org.apache.hadoop.hbase.client.HConnectionManager>Trying to read /hbase/root-region-server
11/01/18 02:43:22 INFO zookeeper.ClientCnxn: Socket connection established to ip-10-98-71-63.ec2.internal/10.98.71.63:2181, initiating session
11/01/18 02:43:22 INFO zookeeper.ClientCnxn: Session establishment complete on server ip-10-98-71-63.ec2.internal/10.98.71.63:2181, sessionid = 0x12d92c700f601bc, negotiated timeout = 40000
11/01/18 02:43:22 DEBUG zookeeper.ZooKeeperWrapper: <10.98.71.63:/hbase,org.apache.hadoop.hbase.client.HConnectionManager>Read ZNode /hbase/root-region-server got 10.112.6.105:60020
11/01/18 02:43:22 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.112.6.105:60020
11/01/18 02:43:22 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1.1028785192 is ip-10-117-82-50.ec2.internal:60020
11/01/18 02:43:22 INFO loadtable: REGION => {NAME => 'JacobsMawfuckingTable,,1295318602815.5f199f04ff0024eb04cd038392705f65.', STARTKEY => '', ENDKEY => '', ENCODED => 5f199f04ff0024eb04cd038392705f65, TABLE => {{NAME => 'JacobsMawfuckingTable', FAMILIES => [{NAME => 'Magnificent', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
11/01/18 02:43:22 INFO loadtable: Moved hdfs://ip-10-98-71-63.ec2.internal/tmp/hbase_test/out/Magnificent/6133023688808851821 to hdfs://ip-10-98-71-63.ec2.internal:8020/hadoop/hbase/JacobsMawfuckingTable/5f199f04ff0024eb04cd038392705f65/Magnificent/6133023688808851821
11/01/18 02:43:22 INFO loadtable: Inserted REGION => {NAME => 'JacobsMawfuckingTable,,1295318602815.5f199f04ff0024eb04cd038392705f65.', STARTKEY => '', ENDKEY => '', ENCODED => 5f199f04ff0024eb04cd038392705f65, TABLE => {{NAME => 'JacobsMawfuckingTable', FAMILIES => [{NAME => 'Magnificent', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
11/01/18 02:43:22 INFO zookeeper.ZooKeeper: Session: 0x12d92c700f601bc closed
11/01/18 02:43:22 DEBUG zookeeper.ZooKeeperWrapper: <10.98.71.63:/hbase,org.apache.hadoop.hbase.client.HConnectionManager>Closed connection with ZooKeeper; /hbase/root-region-server