shardnit

2012-07-31 12:49:17
Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode):

"elasticsearch[node2][bulk][T#747]" daemon prio=10 tid=0x00007f5e30828000 nid=0x6e64 waiting on condition [0x00007f5e34d09000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004001af918> (a java.util.concurrent.SynchronousQueue$TransferStack)
	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
	at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:453)
	at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:352)

shardnit

2012-07-31 12:49:52
Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode):

"Attach Listener" daemon prio=10 tid=0x0000000000eb7000 nid=0x61dc waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"elasticsearch[node1][refresh][T#685]" daemon prio=10 tid=0x000000000141c000 nid=0x6099 waiting on condition [0x00007f3e24fab000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x0000000400343e10> (a java.util.concurrent.SynchronousQueue$TransferStack)

shardnit

[2012-07-20 12:29:05,072][WARN ][action.index             ] [node3] Failed to perform index on replica [index_with_metrics][8]
org.elasticsearch.transport.RemoteTransportException: [node1][inet[/188.165.232.160:9300]][index/replica]
Caused by: org.elasticsearch.index.mapper.MapperParsingException: Failed to parse
        at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:508)
        at org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:437)
        at org.elasticsearch.index.shard.service.InternalIndexShard.prepareIndex(InternalIndexShard.java:311)
        at org.elasticsearch.action.index.TransportIndexAction.shardOperationOnReplica(TransportIndexAction.java:257)
        at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$ReplicaOperationTransportHandler.messageReceived(TransportShardReplicationOperationAction.java:255)
        at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$ReplicaOper

shardnit

[2012-07-01 23:03:47,754][WARN ][indices.cluster          ] [node5] [ranking_index][8] failed to start shard
org.elasticsearch.index.gateway.IndexShardGatewayRecoveryException: [ranking_index][8] failed recovery
	at org.elasticsearch.index.gateway.IndexShardGatewayService$1.run(IndexShardGatewayService.java:228)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
	at java.lang.Thread.run(Thread.java:636)
Caused by: org.elasticsearch.index.engine.EngineCreationFailureException: [ranking_index][8] Failed to create engine
	at org.elasticsearch.index.engine.robin.RobinEngine.start(RobinEngine.java:251)
	at org.elasticsearch.index.shard.service.InternalIndexShard.start(InternalIndexShard.java:272)
	at org.elasticsearch.index.gateway.local.LocalIndexShardGateway.recover(LocalIndexShardGateway.java:180)

shardnit

[2012-07-01 19:51:59,619][DEBUG][action.search.type       ] [node4] [472] Failed to execute fetch phase
org.elasticsearch.transport.RemoteTransportException: [node1][inet[/188.165.232.160:9300]][search/phase/fetch/id]
Caused by: org.elasticsearch.search.fetch.FetchPhaseExecutionException: [rolling_index][9]: query[ConstantScore(NotDeleted(BooleanFilter( +cache(is_porn:F) +created_at:{0 TO 1341165118999])))],from[0],size[1000],sort[<custom:"created_at": org.elasticsearch.index.field.data.longs.LongFieldDataType$1@539e6baa>!]: Fetch Failed [Failed to fetch doc id [16684009]]
	at org.elasticsearch.search.fetch.FetchPhase.loadDocument(FetchPhase.java:289)
	at org.elasticsearch.search.fetch.FetchPhase.execute(FetchPhase.java:158)
	at org.elasticsearch.search.SearchService.executeFetchPhase(SearchService.java:430)
	at org.elasticsearch.search.action.SearchServiceTransportAction$SearchFetchByIdTransportHandler.messageReceived(SearchServiceTransportAction.java:602)
	at org.elasticsearch.search.action.SearchServiceTra

shardnit

{"query":{"text":{"text":{"query":"the queen", "operator":"and"}}}}

shardnit

{"from":0,
 "size":21,
 "query":{
   "filtered":{
      "query":{
         "bool":{
            "must":[
                   {"bool":{
                           "should":[
                                    {"text":{"text":"the"}},

shardnit

require 'rubygems'
require 'bitcask'
require 'bert'
require 'fileutils'
require 'json'

bitcask_dir = '/home/nitish/downloads/riak/rel/riak/data/bitcask/'
dump_dir = '/home/nitish/bitcask_dump/'
Dir.entries(bitcask_dir).each do |bitcask_file|
        next if bitcask_file =~ /\A\./

shardnit

curl -d 'http://localhost:9200/pictures/_search' -d 
{
  "query": {
    "has_child":{
      "type":"interaction",
      "filtered" : {
            "query" : {
                "term" : { "text" : "house" }
            },
            "filter" : {

shardnit

{
  id: md5(url),
  url: "http://skylin.es",
  interactions: [
    {user: "userabc", description: "text", created_at: 11-1-2011},
    {user: "foo bar", followers: 123, description: "text", created_at: 12-1-2011},
    {user: "userabc", description: "text", created_at: 11-1-2011, likes: 1234}
  ],
  rank: 23
}