Skip to content

Instantly share code, notes, and snippets.

@shrijeet
Created April 25, 2012 00:18
Show Gist options
  • Save shrijeet/2484821 to your computer and use it in GitHub Desktop.
Save shrijeet/2484821 to your computer and use it in GitHub Desktop.
Slow scan saga
St^Ack: Sorry I was away. It is just spinning
shrijeet: I had wr itten a nice sequence of events , but then pastie.org decided to go down
shrijeet: anyways, here is the sequence 1) Launch a scanner which is slow, example scan hits once in billion 2) see entry in rs active calls list of type 'next'
shrijeet: 3) as soon that next call hits 60 second mark one more entry in rpc call list appears, this new rpc call is 'close'
shrijeet: 4) client does not see the exception untill close hits 60 second mark
shrijeet: 5) client dies once it sees exception (after 2 minutes) but next and close continue remotely
shrijeet: 6) they hang out in active call list of >30 minutes then they go away, region server spits our some warning in between
shrijeet: The warnings being org.apache.hadoop.hbase.UnknownScannerException, org.apache.hadoop.ipc.HBaseServer (output error) etc.
shrijeet: Here is a JSON snapshot of the state I described in (6) http://pastie.org/3842252
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment