Created
April 25, 2012 00:18
-
-
Save shrijeet/2484821 to your computer and use it in GitHub Desktop.
Slow scan saga
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
St^Ack: Sorry I was away. It is just spinning | |
shrijeet: I had wr itten a nice sequence of events , but then pastie.org decided to go down | |
shrijeet: anyways, here is the sequence 1) Launch a scanner which is slow, example scan hits once in billion 2) see entry in rs active calls list of type 'next' | |
shrijeet: 3) as soon that next call hits 60 second mark one more entry in rpc call list appears, this new rpc call is 'close' | |
shrijeet: 4) client does not see the exception untill close hits 60 second mark | |
shrijeet: 5) client dies once it sees exception (after 2 minutes) but next and close continue remotely | |
shrijeet: 6) they hang out in active call list of >30 minutes then they go away, region server spits our some warning in between | |
shrijeet: The warnings being org.apache.hadoop.hbase.UnknownScannerException, org.apache.hadoop.ipc.HBaseServer (output error) etc. | |
shrijeet: Here is a JSON snapshot of the state I described in (6) http://pastie.org/3842252 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment