shrijeet’s gists

shrijeet / root.log

Created August 24, 2012 22:09

Root rs log during NPE

This file has been truncated, but you can view the full file.

	Wed Aug 22 20:08:25 EDT 2012 Starting regionserver on ine-48.rfiserve.net
	core file size (blocks, -c) 0
	data seg size (kbytes, -d) unlimited
	scheduling priority (-e) 0
	file size (blocks, -f) unlimited
	pending signals (-i) 794624
	max locked memory (kbytes, -l) 32
	max memory size (kbytes, -m) unlimited
	open files (-n) 65536
	pipe size (512 bytes, -p) 8

shrijeet / master.log

Created August 24, 2012 22:16

Master Log while NPE

This file has been truncated, but you can view the full file.

	Wed Aug 22 20:24:33 EDT 2012 Starting master on ine-60.rfiserve.net
	core file size (blocks, -c) 0
	data seg size (kbytes, -d) unlimited
	scheduling priority (-e) 0
	file size (blocks, -f) unlimited
	pending signals (-i) 278528
	max locked memory (kbytes, -l) 32
	max memory size (kbytes, -m) unlimited
	open files (-n) 65536
	pipe size (512 bytes, -p) 8

shrijeet / HBaseIncExample.java

Created September 20, 2012 23:50

[bug report] Client shutdown (without explicit flush) does not flush buffered atomic increments

	import org.hbase.async.AtomicIncrementRequest;
	import org.hbase.async.HBaseClient;

	public class HBaseIncExample {

	public static void main(String [] args) throws Exception {
	HBaseClient client = new HBaseClient("rasalghul");
	AtomicIncrementRequest req = new AtomicIncrementRequest("t0", "k1", "f1", "q1");

	for (int i = 0; i < 100; i++) {

shrijeet / jt_hung.java

Created October 8, 2012 21:12

JT hung





	2012-10-05 22:51:31
	Full thread dump Java HotSpot(TM) 64-Bit Server VM (14.2-b01 mixed mode):

	"IPC Client (47) connection to master-hadoop.inw-hercules.rfiserve.net/172.22.24.45:8020 from hdfs" daemon prio=10 tid=0x00007f13b4fa5000 nid=0x48d6 in Object.wait() [0x00007f09c8855000]
	java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)

shrijeet / FilterRowsWithGivenColumns.java

Created October 16, 2012 23:46

FilterRowsWithGivenColumns MapReduce program

	package hbase.experiments;

	import java.io.IOException;
	import java.util.ArrayList;
	import java.util.Arrays;
	import java.util.HashSet;
	import java.util.List;

	import org.apache.hadoop.conf.Configuration;
	import org.apache.hadoop.fs.Path;

shrijeet / RenameTable.java

Created October 18, 2012 17:30

A program to rename HBase table (works for 0.92.x)


	package hbase.experiments;

	import java.io.FileNotFoundException;
	import java.io.IOException;

	import org.apache.commons.logging.Log;
	import org.apache.commons.logging.LogFactory;
	import org.apache.hadoop.conf.Configuration;
	import org.apache.hadoop.fs.FSDataOutputStream;

shrijeet / error_trace_hung_client.java

Created October 19, 2012 01:15

Error stack track for asynchbase client getting hung

	12/09/23 15:02:18 ERROR async.RegionClient: Unexpected exception from downstream on [id: 0x5cac6a45, /172.22.8.8:44666 => /172.22.4.46:60020]
	java.io.IOException: Connection reset by peer
	at sun.nio.ch.FileDispatcher.read0(Native Method)
	at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
	at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:233)
	at sun.nio.ch.IOUtil.read(IOUtil.java:200)
	at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:236)
	at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:63)
	at org.jboss.netty.channel.socket.nio.AbstractNioWorker.processSelectedKeys(AbstractNioWorker.java:373)
	at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:247)

shrijeet / jstack_hung_client.txt

Created October 19, 2012 01:37

jstack track for asynchbase client getting hung

	2012-10-18 21:10:34
	Full thread dump Java HotSpot(TM) 64-Bit Server VM (14.2-b01 mixed mode):

	"Attach Listener" daemon prio=10 tid=0x000000004a0af800 nid=0x1292 waiting on condition [0x0000000000000000]
	java.lang.Thread.State: RUNNABLE

	"New I/O worker #139" prio=10 tid=0x0000000049978800 nid=0x477a runnable [0x0000000043554000]
	java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:215)

shrijeet / TooManyPending.java

Created November 9, 2012 19:02

[asynchbase] Too many pending RPC

	/**
	* The errback associated with the row. If any of the put (one each column)
	* fails, this errback will be invoked with a DeferredGroupException in
	* argument.
	*/
	final class WriteErrback implements Callback<Object, Exception> {
	public Exception call(final Exception arg) {
	metrics.getWriteFailed().inc();
	metrics.getWritePending().dec();
	return arg;

shrijeet / splits_2012-11-09.log

Created November 10, 2012 18:24

Counting splits ine-arp & tca-arp on 2012-11-09

	[13:22]shrijeet@ine-60:/srv/logs/hadoop-->grep "mkdirs.*splits" hadoop-hadoop-namenode-ine-60.rfiserve.net.log.2012-11-09
	2012-11-09 02:40:02,524 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=hbase ip=/172.22.2.32 cmd=mkdirs src=/hbase/ine-arp/userprofile/01646cb1eabaa3d9527884b598e34fef/.splits dst=null perm=hbase:supergroup:rwxr-xr-x
	2012-11-09 03:25:24,614 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=hbase ip=/172.22.2.32 cmd=mkdirs src=/hbase/ine-arp/userprofile/30f4e090f947b5e70fa012019666f5c3/.splits dst=null perm=hbase:supergroup:rwxr-xr-x
	2012-11-09 12:06:25,230 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=hbase ip=/172.22.2.47 cmd=mkdirs src=/hbase/ine-arp/userprofile/5952cc659613fccd0b09e76159df8a28/.splits dst=null perm=hbase:supergroup:rwxr-xr-x
	2012-11-09 13:09:43,052 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit: ugi=hbase ip=/172.22.2.52 cmd=mkdirs src=/hbase/ine-arp/userprofile/25e130dde803393d96c740f8e37a419

Shrijeet shrijeet