Shrijeet shrijeet
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.hbase.async.HBaseClient; | |
| import org.hbase.async.PutRequest; | |
| import org.slf4j.Logger; | |
| import org.slf4j.LoggerFactory; | |
| import com.stumbleupon.async.Callback; | |
| public class AsyncPutExample { | |
| private static final Logger LOG = LoggerFactory.getLogger(AsyncPutExample.class); | |
| private static long err_ed; |
shrijeet
/ PutDeleteBug.java
Created
July 25, 2012 18:42
Program to reproduce bug in asynchbase client when delete followed by put is performed on set of tables
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.hbase.async.DeleteRequest; | |
| import org.hbase.async.HBaseClient; | |
| import org.hbase.async.PutRequest; | |
| public class PutDeleteBug { | |
| public static void main(String args[]) throws Exception { | |
| final HBaseClient client = new HBaseClient("pww-30"); | |
| for (int i = 0; i < 2; i++) { |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2012-07-25 11:50:36,378 DEBUG [main] AsyncPutRequestFileWriter: Set file called for /tmp/asyncputs.bin | |
| 2012-07-25 11:50:36,383 DEBUG [main] AsyncPutRequestFileWriter: setFile ended | |
| 2012-07-25 11:50:36,383 DEBUG [main] AsyncPutRequestFileWriter: Opening AsyncFileWriter. | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:host.name=10.241.94.172 | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:java.version=1.6.0_32 | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:java.vendor=Apple Inc. | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:java.home=/Library/Java/JavaVirtualMachines/1.6.0_32-b05-420.jdk/Contents/Home | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:java.class.path=/Users/shrijeet/Documents/workspace/asynchbase.experiments/bin:/Users/shrijeet/git_ws/grid/thirdparty/asynchbase/target/class |
shrijeet
/ regionserver_putdeletebug.log
Created
July 25, 2012 18:55
Region server log for PutDeleteBug
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2012-07-25 14:50:34,946 WARN org.apache.hadoop.ipc.HBaseServer: Unable to read call parameters for client 192.168.100.252 | |
| java.io.IOException: Error in readFields | |
| at org.apache.hadoop.hbase.io.HbaseObjectWritable.readObject(HbaseObjectWritable.java:655) | |
| at org.apache.hadoop.hbase.ipc.Invocation.readFields(Invocation.java:125) | |
| at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.processData(HBaseServer.java:1238) | |
| at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:1167) | |
| at org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:703) | |
| at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.doRunLoop(HBaseServer.java:495) | |
| at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:470) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) |
shrijeet
/ FilterListExample.java
Created
July 31, 2012 20:35
Find all rows which do not have a cell corresponding to any of the columns in the given list of columns.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package hbase.experiments; | |
| import java.io.IOException; | |
| import java.util.ArrayList; | |
| import java.util.List; | |
| import org.apache.hadoop.conf.Configuration; | |
| import org.apache.hadoop.hbase.HBaseConfiguration; | |
| import org.apache.hadoop.hbase.KeyValue; |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <property> | |
| <name>hadoop.proxyuser.oozie.hosts</name> | |
| <value>*</value> | |
| </property> | |
| <property> | |
| <name>hadoop.proxyuser.oozie.groups</name> | |
| <value>*</value> | |
| </property> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| jvm.metrics: hostName=inw-5.rfiserve.net, processName=NameNode, sessionId=, gcCount=37845, gcTimeMillis=6003961, logError=0, logFatal=0, logInfo=128826946, logWarn=4218, maxMemoryM=10666.6875, memHeapCommittedM=7094.8125, memHeapUsedM=5518.711, memNonHeapCommittedM=27.5, memNonHeapUsedM=27.320305, threadsBlocked=0, threadsNew=0, threadsRunnable=11, threadsTerminated=0, threadsTimedWaiting=8, threadsWaiting=44 | |
| jvm.metrics: hostName=inw-5.rfiserve.net, processName=NameNode, sessionId=, gcCount=38113, gcTimeMillis=6041969, logError=0, logFatal=0, logInfo=129717263, logWarn=4235, maxMemoryM=10666.6875, memHeapCommittedM=7094.1875, memHeapUsedM=3677.5535, memNonHeapCommittedM=27.5, memNonHeapUsedM=27.320305, threadsBlocked=0, threadsNew=0, threadsRunnable=9, threadsTerminated=0, threadsTimedWaiting=8, threadsWaiting=46 | |
| jvm.metrics: hostName=inw-5.rfiserve.net, processName=NameNode, sessionId=, gcCount=38379, gcTimeMillis=6089254, logError=0, logFatal=0, logInfo=130416613, logWarn=4244, maxMemoryM=10666.6875, memHe |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <?xml version='1.0' encoding='UTF-8'?><feed xmlns='http://www.w3.org/2005/Atom' xmlns:apps='http://schemas.google.com/apps/2006'> | |
| <title>Mail Filters</title> | |
| <id>tag:mail.google.com,2008:filters:1345244786967</id> | |
| <updated>2012-08-17T23:07:52Z</updated> | |
| <author> | |
| <name>Shrijeet Paliwal</name> | |
| <email>[email protected]</email> | |
| </author> | |
| <entry> | |
| <category term='filter'></category> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| * MSLAB - Okay to leave it turned ON 0.92.2 onwards since we have lots of memory and number of regions per region server is not too crazy high (200 regions/per RS) | |
| * Distributed splitting - Want it! | |
| * Memory accounting is different now - Okay to leave block cache's value same as it was in 0.90.0 since its already set to a liberal value (0.45) | |
| * Experimental off-heap cache - Leave it turned off. | |
| * Region max file size - Currently set to 2GB, we should go up. 4GB will cut our regions / per region server to under 100. |
shrijeet
/ npe_rs_0.92.2.log
Created
August 24, 2012 20:46
Null pointer exception in region server 0.92.2
This file has been truncated, but you can view the full file.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Wed Aug 22 20:15:03 EDT 2012 Starting regionserver on ine-51.rfiserve.net | |
| core file size (blocks, -c) 0 | |
| data seg size (kbytes, -d) unlimited | |
| scheduling priority (-e) 0 | |
| file size (blocks, -f) unlimited | |
| pending signals (-i) 794624 | |
| max locked memory (kbytes, -l) 32 | |
| max memory size (kbytes, -m) unlimited | |
| open files (-n) 65536 | |
| pipe size (512 bytes, -p) 8 |