Shrijeet shrijeet
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <property> | |
| <name>hadoop.proxyuser.oozie.hosts</name> | |
| <value>*</value> | |
| </property> | |
| <property> | |
| <name>hadoop.proxyuser.oozie.groups</name> | |
| <value>*</value> | |
| </property> |
shrijeet
/ FilterListExample.java
Created
July 31, 2012 20:35
Find all rows which do not have a cell corresponding to any of the columns in the given list of columns.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package hbase.experiments; | |
| import java.io.IOException; | |
| import java.util.ArrayList; | |
| import java.util.List; | |
| import org.apache.hadoop.conf.Configuration; | |
| import org.apache.hadoop.hbase.HBaseConfiguration; | |
| import org.apache.hadoop.hbase.KeyValue; |
shrijeet
/ regionserver_putdeletebug.log
Created
July 25, 2012 18:55
Region server log for PutDeleteBug
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2012-07-25 14:50:34,946 WARN org.apache.hadoop.ipc.HBaseServer: Unable to read call parameters for client 192.168.100.252 | |
| java.io.IOException: Error in readFields | |
| at org.apache.hadoop.hbase.io.HbaseObjectWritable.readObject(HbaseObjectWritable.java:655) | |
| at org.apache.hadoop.hbase.ipc.Invocation.readFields(Invocation.java:125) | |
| at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.processData(HBaseServer.java:1238) | |
| at org.apache.hadoop.hbase.ipc.HBaseServer$Connection.readAndProcess(HBaseServer.java:1167) | |
| at org.apache.hadoop.hbase.ipc.HBaseServer$Listener.doRead(HBaseServer.java:703) | |
| at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.doRunLoop(HBaseServer.java:495) | |
| at org.apache.hadoop.hbase.ipc.HBaseServer$Listener$Reader.run(HBaseServer.java:470) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2012-07-25 11:50:36,378 DEBUG [main] AsyncPutRequestFileWriter: Set file called for /tmp/asyncputs.bin | |
| 2012-07-25 11:50:36,383 DEBUG [main] AsyncPutRequestFileWriter: setFile ended | |
| 2012-07-25 11:50:36,383 DEBUG [main] AsyncPutRequestFileWriter: Opening AsyncFileWriter. | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:host.name=10.241.94.172 | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:java.version=1.6.0_32 | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:java.vendor=Apple Inc. | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:java.home=/Library/Java/JavaVirtualMachines/1.6.0_32-b05-420.jdk/Contents/Home | |
| 2012-07-25 11:50:36,410 INFO [main] ZooKeeper: Client environment:java.class.path=/Users/shrijeet/Documents/workspace/asynchbase.experiments/bin:/Users/shrijeet/git_ws/grid/thirdparty/asynchbase/target/class |
shrijeet
/ PutDeleteBug.java
Created
July 25, 2012 18:42
Program to reproduce bug in asynchbase client when delete followed by put is performed on set of tables
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.hbase.async.DeleteRequest; | |
| import org.hbase.async.HBaseClient; | |
| import org.hbase.async.PutRequest; | |
| public class PutDeleteBug { | |
| public static void main(String args[]) throws Exception { | |
| final HBaseClient client = new HBaseClient("pww-30"); | |
| for (int i = 0; i < 2; i++) { |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import org.hbase.async.HBaseClient; | |
| import org.hbase.async.PutRequest; | |
| import org.slf4j.Logger; | |
| import org.slf4j.LoggerFactory; | |
| import com.stumbleupon.async.Callback; | |
| public class AsyncPutExample { | |
| private static final Logger LOG = LoggerFactory.getLogger(AsyncPutExample.class); | |
| private static long err_ed; |
shrijeet
/ gist:3093276
Created
July 11, 2012 20:46
— forked from anonymous/gist:3093240
JobTracker fails to start: "java.lang.IllegalArgumentException: Does not contain a valid host:port authority: local"
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <?xml version="1.0"?> | |
| <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> | |
| <!-- Put site-specific property overrides in this file. --> | |
| <configuration> | |
| <property> | |
| <name>mapred.job.tracker</name> | |
| <value>MASTER:8021</value> |
shrijeet
/ 0001-Support-client-RPC-operation-level-timeout.patch
Created
June 18, 2012 21:27
Asynchbase rpc timeout first cut
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| From 2fd88425c5848059fbefc7f85ce14858bbbe7775 Mon Sep 17 00:00:00 2001 | |
| From: Shrijeet Paliwal <[email protected]> | |
| Date: Mon, 18 Jun 2012 14:25:21 -0700 | |
| Subject: [PATCH] Support client RPC operation level timeout | |
| --- | |
| Makefile | 1 + | |
| src/GetRequest.java | 24 ++++++++++++++++++++++-- | |
| src/HBaseClient.java | 16 ++++++++++++++++ | |
| src/HBaseRpc.java | 24 ++++++++++++++++++++++++ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python | |
| import sys | |
| import os | |
| """ | |
| Modify this config section based on needs | |
| 1) hostrack_data : a file containing lines, a line represents one host | |
| 2) field_sep: separator used for fields in one line | |
| 3) log: disable/enable logging |
shrijeet
/ PBSerialize.java
Created
April 29, 2012 01:00
A Protobuffer implementation of com.esotericsoftware.kryo.Serializer
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| public abstract class PBSerialize<T extends Message> extends | |
| Serializer { | |
| protected abstract T parseForm(CodedInputStream in); | |
| private final ThreadLocal<byte[]> thread_local_buffer = new ThreadLocal<byte[]>() { | |
| @Override | |
| protected byte[] initialValue() { | |
| return new byte[1024 * 10]; // 10 KB | |
| } |