Skip to content

Instantly share code, notes, and snippets.

@parth-patil
Last active January 2, 2016 15:08
Show Gist options
  • Save parth-patil/8321035 to your computer and use it in GitHub Desktop.
Save parth-patil/8321035 to your computer and use it in GitHub Desktop.
Detailed log from index task job
2014-01-08 18:06:17,749 INFO [main] io.druid.server.initialization.PropertiesModule - Loading properties from runtime.properties
2014-01-08 18:06:17,781 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.0.1.Final
2014-01-08 18:06:18,208 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[], localRepository='/Users/parth/.m2/repository', remoteRepositories=[http://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2014-01-08 18:06:18,833 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2014-01-08 18:06:18,895 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@1b894623]
2014-01-08 18:06:18,909 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
2014-01-08 18:06:18,930 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='overlord', host='localhost:8088', port=8088}]
2014-01-08 18:06:18,990 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [io.druid.indexing.common.config.TaskConfig@2d3c5270]
2014-01-08 18:06:18,995 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.guice.HttpClientModule$DruidHttpClientConfig] from props[druid.global.http.] as [io.druid.guice.HttpClientModule$DruidHttpClientConfig@78c5e1cc]
2014-01-08 18:06:19,045 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [io.druid.client.indexing.IndexingServiceSelectorConfig@4718cbff]
2014-01-08 18:06:19,047 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [localhost] for [druid.zk.service.host] on [io.druid.curator.CuratorConfig#getZkHosts()]
2014-01-08 18:06:19,049 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [30000] for [druid.zk.service.sessionTimeoutMs] on [io.druid.curator.CuratorConfig#getZkSessionTimeoutMs()]
2014-01-08 18:06:19,049 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [false] for [druid.curator.compress] on [io.druid.curator.CuratorConfig#enableCompression()]
2014-01-08 18:06:19,107 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2014-01-08 18:06:19,140 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [io.druid.server.initialization.CuratorDiscoveryConfig@5c64885]
2014-01-08 18:06:19,261 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [io.druid.indexing.common.RetryPolicyConfig@1c3ceacd]
2014-01-08 18:06:19,265 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [io.druid.segment.loading.LocalDataSegmentPusherConfig@23a8a61e]
2014-01-08 18:06:19,277 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.client.DruidServerConfig] from props[druid.server.] as [io.druid.client.DruidServerConfig@1c2859eb]
2014-01-08 18:06:19,278 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.liveSegmentsPath] on [io.druid.server.initialization.ZkPathsConfig#getLiveSegmentsPath()]
2014-01-08 18:06:19,278 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.announcementsPath] on [io.druid.server.initialization.ZkPathsConfig#getAnnouncementsPath()]
2014-01-08 18:06:19,279 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.servedSegmentsPath] on [io.druid.server.initialization.ZkPathsConfig#getServedSegmentsPath()]
2014-01-08 18:06:19,279 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.loadQueuePath] on [io.druid.server.initialization.ZkPathsConfig#getLoadQueuePath()]
2014-01-08 18:06:19,279 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.base] on [io.druid.server.initialization.ZkPathsConfig#getZkBasePath()]
2014-01-08 18:06:19,279 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.coordinatorPath] on [io.druid.server.initialization.ZkPathsConfig#getCoordinatorPath()]
2014-01-08 18:06:19,279 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.propertiesPath] on [io.druid.server.initialization.ZkPathsConfig#getPropertiesPath()]
2014-01-08 18:06:19,279 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.announcementsPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerAnnouncementPath()]
2014-01-08 18:06:19,279 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.tasksPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerTaskPath()]
2014-01-08 18:06:19,280 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.statusPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerStatusPath()]
2014-01-08 18:06:19,280 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.zk.paths.indexer.leaderLatchPath] on [io.druid.server.initialization.ZkPathsConfig#getIndexerLeaderLatchPath()]
2014-01-08 18:06:19,310 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [io.druid.server.initialization.BatchDataSegmentAnnouncerConfig@1e86486b]
2014-01-08 18:06:19,314 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [io.druid.server.coordination.LegacyDataSegmentAnnouncerProvider@533c296e]
2014-01-08 18:06:19,319 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.client.ServerInventoryViewProvider] from props[druid.announcer.] as [io.druid.client.SingleServerInventoryProvider@6c553965]
2014-01-08 18:06:19,325 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.QueryConfig] from props[druid.query.] as [io.druid.query.QueryConfig@3ecfdb7e]
2014-01-08 18:06:19,331 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.search.search.SearchQueryConfig] from props[druid.query.search.] as [io.druid.query.search.search.SearchQueryConfig@767dfcb6]
2014-01-08 18:06:19,337 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [io.druid.query.groupby.GroupByQueryConfig@2bf37fa]
2014-01-08 18:06:19,337 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [268435456] for [druid.computation.buffer.size] on [io.druid.server.DruidProcessingConfig#intermediateComputeSizeBytes()]
2014-01-08 18:06:19,337 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [1] for [${base_path}.numThreads] on [com.metamx.common.concurrent.ExecutorServiceConfig#getNumThreads()]
2014-01-08 18:06:19,337 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [com.metamx.common.concurrent.ExecutorServiceConfig#getFormatString()]
2014-01-08 18:06:19,347 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[interface io.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [io.druid.server.log.NoopRequestLoggerProvider@211e0823]
2014-01-08 18:06:19,352 INFO [main] io.druid.guice.JsonConfigurator - Loaded class[class io.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [io.druid.server.initialization.ServerConfig@3050d24]
2014-01-08 18:06:19,412 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.core.LoggingEmitter.start()] on object[com.metamx.emitter.core.LoggingEmitter@5087d5ce].
2014-01-08 18:06:19,413 INFO [main] com.metamx.emitter.core.LoggingEmitter - Start: started [true]
2014-01-08 18:06:19,413 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.emitter.service.ServiceEmitter.start()] on object[com.metamx.emitter.service.ServiceEmitter@59e612eb].
2014-01-08 18:06:19,413 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.metrics.MonitorScheduler.start()] on object[com.metamx.metrics.MonitorScheduler@fe43069].
2014-01-08 18:06:19,415 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void com.metamx.http.client.HttpClient.start()] on object[com.metamx.http.client.HttpClient@45d3972c].
2014-01-08 18:06:19,416 INFO [main] io.druid.curator.CuratorModule - Starting Curator
2014-01-08 18:06:19,416 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=10.0.227.58
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_45
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.7.0_45.jdk/Contents/Home/jre
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=lib/aether-api-0.9.0.M2.jar:lib/aether-connector-file-0.9.0.M2.jar:lib/aether-connector-okhttp-0.0.9.jar:lib/aether-impl-0.9.0.M2.jar:lib/aether-spi-0.9.0.M2.jar:lib/aether-util-0.9.0.M2.jar:lib/airline-0.6.jar:lib/antlr4-runtime-4.0.jar:lib/aopalliance-1.0.jar:lib/asm-3.1.jar:lib/aws-java-sdk-1.6.0.1.jar:lib/bytebuffer-collections-0.0.2.jar:lib/classmate-0.8.0.jar:lib/commons-cli-1.2.jar:lib/commons-codec-1.7.jar:lib/commons-dbcp-1.4.jar:lib/commons-io-2.0.1.jar:lib/commons-lang-2.6.jar:lib/commons-logging-1.1.1.jar:lib/commons-pool-1.6.jar:lib/compress-lzf-0.8.4.jar:lib/config-magic-0.9.jar:lib/curator-client-2.1.0-incubating.jar:lib/curator-framework-2.1.0-incubating.jar:lib/curator-recipes-2.1.0-incubating.jar:lib/curator-x-discovery-2.1.0-incubating.jar:lib/druid-api-0.1.7.jar:lib/druid-common-0.6.39.jar:lib/druid-indexing-hadoop-0.6.39.jar:lib/druid-indexing-service-0.6.39.jar:lib/druid-processing-0.6.39.jar:lib/druid-server-0.6.39.jar:lib/druid-services-0.6.39.jar:lib/emitter-0.2.6.jar:lib/extendedset-1.3.4.jar:lib/geoip2-0.4.0.jar:lib/google-http-client-1.15.0-rc.jar:lib/google-http-client-jackson2-1.15.0-rc.jar:lib/guava-14.0.1.jar:lib/guice-4.0-beta.jar:lib/guice-multibindings-4.0-beta.jar:lib/guice-servlet-4.0-beta.jar:lib/hibernate-validator-5.0.1.Final.jar:lib/http-client-0.8.4.jar:lib/httpclient-4.2.jar:lib/httpcore-4.2.jar:lib/icu4j-4.8.1.jar:lib/irc-api-1.0-0011.jar:lib/jackson-annotations-2.2.2.jar:lib/jackson-core-2.2.2.jar:lib/jackson-core-asl-1.9.11.jar:lib/jackson-databind-2.2.2.jar:lib/jackson-dataformat-smile-2.2.2.jar:lib/jackson-datatype-guava-2.2.2.jar:lib/jackson-datatype-joda-2.2.2.jar:lib/jackson-jaxrs-base-2.2.2.jar:lib/jackson-jaxrs-json-provider-2.2.2.jar:lib/jackson-mapper-asl-1.9.11.jar:lib/jackson-module-jaxb-annotations-2.2.2.jar:lib/java-util-0.25.1.jar:lib/java-xmlbuilder-0.4.jar:lib/javax.inject-1.jar:lib/javax.servlet-3.0.0.v201112011016.jar:lib/jboss-logging-3.1.1.GA.jar:lib/jdbi-2.32.jar:lib/jersey-core-1.17.1.jar:lib/jersey-guice-1.17.1.jar:lib/jersey-server-1.17.1.jar:lib/jersey-servlet-1.17.1.jar:lib/jets3t-0.9.0.jar:lib/jetty-client-8.1.11.v20130520.jar:lib/jetty-continuation-8.1.11.v20130520.jar:lib/jetty-http-8.1.11.v20130520.jar:lib/jetty-io-8.1.11.v20130520.jar:lib/jetty-security-8.1.11.v20130520.jar:lib/jetty-server-8.1.11.v20130520.jar:lib/jetty-servlet-8.1.11.v20130520.jar:lib/jetty-servlets-8.1.11.v20130520.jar:lib/jetty-util-8.1.11.v20130520.jar:lib/jline-0.9.94.jar:lib/joda-time-2.1.jar:lib/jsr305-2.0.1.jar:lib/log4j-1.2.16.jar:lib/lz4-1.1.2.jar:lib/maven-aether-provider-3.1.1.jar:lib/maven-model-3.1.1.jar:lib/maven-model-builder-3.1.1.jar:lib/maven-repository-metadata-3.1.1.jar:lib/maven-settings-3.1.1.jar:lib/maven-settings-builder-3.1.1.jar:lib/maxminddb-0.2.0.jar:lib/mysql-connector-java-5.1.18.jar:lib/netty-3.2.4.Final.jar:lib/okhttp-1.0.2.jar:lib/opencsv-2.3.jar:lib/org.abego.treelayout.core-1.0.1.jar:lib/plexus-interpolation-1.19.jar:lib/plexus-utils-3.0.15.jar:lib/protobuf-java-2.4.0a.jar:lib/rhino-1.7R4.jar:lib/server-metrics-0.0.5.jar:lib/sigar-1.6.5.132.jar:lib/slf4j-api-1.6.4.jar:lib/slf4j-log4j12-1.6.2.jar:lib/spymemcached-2.8.4.jar:lib/tesla-aether-0.0.5.jar:lib/validation-api-1.1.0.Final.jar:lib/wagon-provider-api-2.4.jar:lib/xpp3-1.1.4c.jar:lib/zookeeper-3.4.5.jar:config/overlord
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/Users/parth/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/var/folders/k5/_c5gk_857r54gqfb0d7rhzkr0000gn/T/
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Mac OS X
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=x86_64
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=10.8.5
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=parth
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/Users/parth
2014-01-08 18:06:19,423 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/Users/parth/temp/druid-services-0.6.39
2014-01-08 18:06:19,424 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@6e0d3322
2014-01-08 18:06:19,437 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[io.druid.curator.discovery.ServerDiscoverySelector@2280cbba].
2014-01-08 18:06:24,440 INFO [main-SendThread(fe80:0:0:0:0:0:0:1%1:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server fe80:0:0:0:0:0:0:1%1/fe80:0:0:0:0:0:0:1%1:2181. Will not attempt to authenticate using SASL (unknown error)
2014-01-08 18:06:24,444 INFO [main-SendThread(fe80:0:0:0:0:0:0:1%1:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to fe80:0:0:0:0:0:0:1%1/fe80:0:0:0:0:0:0:1%1:2181, initiating session
2014-01-08 18:06:24,455 INFO [main-SendThread(fe80:0:0:0:0:0:0:1%1:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server fe80:0:0:0:0:0:0:1%1/fe80:0:0:0:0:0:0:1%1:2181, sessionid = 0x14368d9715c0078, negotiated timeout = 30000
2014-01-08 18:06:24,458 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2014-01-08 18:06:25,527 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.curator.announcement.Announcer.start()] on object[io.druid.curator.announcement.Announcer@c923822].
2014-01-08 18:06:25,528 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.client.ServerInventoryView.start() throws java.lang.Exception] on object[io.druid.client.SingleServerInventoryView@a1d2332].
2014-01-08 18:06:25,531 INFO [main] org.eclipse.jetty.server.Server - jetty-8.1.11.v20130520
2014-01-08 18:06:25,567 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Created new InventoryCacheListener for /druid/servedSegments/localhost:8081
2014-01-08 18:06:25,567 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Starting inventory cache for localhost:8081, inventoryPath /druid/servedSegments/localhost:8081
2014-01-08 18:06:25,568 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - New Server[DruidServerMetadata{name='localhost:8081', host='localhost:8081', maxSize=100000000, tier='_default_tier', type='historical'}]
2014-01-08 18:06:25,592 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v5_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:27:26.387Z]
2014-01-08 18:06:25,594 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv2_2014-01-02T00:00:00.000Z_2014-01-03T00:00:00.000Z_2014-01-08T15:33:29.167Z]
2014-01-08 18:06:25,594 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v9_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:41:01.752Z]
2014-01-08 18:06:25,595 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v20_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T01:39:04.478Z]
2014-01-08 18:06:25,595 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v17_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T01:19:42.707Z]
2014-01-08 18:06:25,596 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v26_2013-07-01T00:00:00.000Z_2013-07-02T00:00:00.000Z_2014-01-07T13:47:45.100Z]
2014-01-08 18:06:25,596 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv4_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T17:52:06.506Z]
2014-01-08 18:06:25,596 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v6_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:29:36.233Z]
2014-01-08 18:06:25,597 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v18_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T01:23:13.086Z]
2014-01-08 18:06:25,597 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv7_2014-01-04T00:00:00.000Z_2014-01-05T00:00:00.000Z_2014-01-08T18:02:58.091Z]
2014-01-08 18:06:25,598 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v23_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T01:58:18.613Z]
2014-01-08 18:06:25,598 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v24_2013-09-30T00:00:00.000Z_2013-10-01T00:00:00.000Z_2014-01-07T02:05:26.354Z]
2014-01-08 18:06:25,599 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v19_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T01:38:14.471Z]
2014-01-08 18:06:25,599 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv3_2014-01-02T00:00:00.000Z_2014-01-03T00:00:00.000Z_2014-01-08T17:42:29.997Z]
2014-01-08 18:06:25,600 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v28_2013-07-03T00:00:00.000Z_2013-07-04T00:00:00.000Z_2014-01-08T06:37:48.345Z]
2014-01-08 18:06:25,601 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v30_2013-07-03T00:00:00.000Z_2013-07-04T00:00:00.000Z_2014-01-08T07:16:30.715Z]
2014-01-08 18:06:25,602 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v10_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:45:07.685Z]
2014-01-08 18:06:25,602 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v16_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T01:17:29.557Z]
2014-01-08 18:06:25,603 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v27_2013-07-02T00:00:00.000Z_2013-07-03T00:00:00.000Z_2014-01-07T13:51:47.605Z]
2014-01-08 18:06:25,603 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v13_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:57:24.619Z]
2014-01-08 18:06:25,604 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv7_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:02:58.091Z]
2014-01-08 18:06:25,604 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[wikipedia_v3_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:05:38.363Z]
2014-01-08 18:06:25,605 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v2_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:15:56.311Z]
2014-01-08 18:06:25,605 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v7_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:31:24.142Z]
2014-01-08 18:06:25,606 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v12_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:50:54.820Z]
2014-01-08 18:06:25,607 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[wikipedia_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-06T23:40:19.219Z]
2014-01-08 18:06:25,607 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv1_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T15:12:38.493Z]
2014-01-08 18:06:25,608 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv2_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T15:33:29.167Z]
2014-01-08 18:06:25,608 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v28_2013-07-04T00:00:00.000Z_2013-07-05T00:00:00.000Z_2014-01-08T06:37:48.345Z]
2014-01-08 18:06:25,609 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v32_2013-07-03T00:00:00.000Z_2013-07-04T00:00:00.000Z_2014-01-08T07:20:31.630Z]
2014-01-08 18:06:25,610 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv6_2014-01-02T00:00:00.000Z_2014-01-03T00:00:00.000Z_2014-01-08T18:00:32.310Z]
2014-01-08 18:06:25,610 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v31_2013-07-03T00:00:00.000Z_2013-07-04T00:00:00.000Z_2014-01-08T07:19:15.559Z]
2014-01-08 18:06:25,611 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[wikipedia_v5_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:26:45.788Z]
2014-01-08 18:06:25,612 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv4_2014-01-03T00:00:00.000Z_2014-01-04T00:00:00.000Z_2014-01-08T17:52:06.506Z]
2014-01-08 18:06:25,613 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[wikipedia_v4_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:25:58.046Z]
2014-01-08 18:06:25,613 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[wikipedia_2013-08-01T00:00:00.000Z_2013-08-02T00:00:00.000Z_2013-08-08T21:22:48.989Z]
2014-01-08 18:06:25,614 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv6_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:00:32.310Z]
2014-01-08 18:06:25,615 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv3_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T17:42:29.997Z]
2014-01-08 18:06:25,615 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v8_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:32:51.228Z]
2014-01-08 18:06:25,616 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v21_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T01:44:24.055Z]
2014-01-08 18:06:25,617 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v32_2013-07-04T00:00:00.000Z_2013-07-05T00:00:00.000Z_2014-01-08T07:20:31.630Z]
2014-01-08 18:06:25,618 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv7_2014-01-03T00:00:00.000Z_2014-01-04T00:00:00.000Z_2014-01-08T18:02:58.091Z]
2014-01-08 18:06:25,618 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v25_2013-07-30T00:00:00.000Z_2013-07-31T00:00:00.000Z_2014-01-07T13:46:23.325Z]
2014-01-08 18:06:25,619 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v15_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T01:14:17.411Z]
2014-01-08 18:06:25,620 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v14_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T01:02:18.060Z]
2014-01-08 18:06:25,620 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[wikipedia_v2_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:01:00.650Z]
2014-01-08 18:06:25,621 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v29_2013-07-03T00:00:00.000Z_2013-07-04T00:00:00.000Z_2014-01-08T07:11:54.460Z]
2014-01-08 18:06:25,622 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v22_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T01:55:43.703Z]
2014-01-08 18:06:25,622 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv6_2014-01-04T00:00:00.000Z_2014-01-05T00:00:00.000Z_2014-01-08T18:00:32.310Z]
2014-01-08 18:06:25,623 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv6_2014-01-03T00:00:00.000Z_2014-01-04T00:00:00.000Z_2014-01-08T18:00:32.310Z]
2014-01-08 18:06:25,623 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v11_2013-08-31T00:00:00.000Z_2013-09-01T00:00:00.000Z_2014-01-07T00:47:00.705Z]
2014-01-08 18:06:25,623 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv7_2014-01-02T00:00:00.000Z_2014-01-03T00:00:00.000Z_2014-01-08T18:02:58.091Z]
2014-01-08 18:06:25,624 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[activities_v27_2013-07-03T00:00:00.000Z_2013-07-04T00:00:00.000Z_2014-01-08T06:36:34.472Z]
2014-01-08 18:06:25,624 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server[localhost:8081] added segment[countriesv4_2014-01-02T00:00:00.000Z_2014-01-03T00:00:00.000Z_2014-01-08T17:52:06.506Z]
Jan 08, 2014 6:06:25 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
Jan 08, 2014 6:06:25 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering io.druid.server.StatusResource as a root resource class
Jan 08, 2014 6:06:25 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.17.1 02/28/2013 12:47 PM'
Jan 08, 2014 6:06:25 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
Jan 08, 2014 6:06:26 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.QueryResource to GuiceInstantiatedComponentProvider
Jan 08, 2014 6:06:26 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.indexing.worker.executor.ChatHandlerResource to GuiceInstantiatedComponentProvider
Jan 08, 2014 6:06:26 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding io.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
2014-01-08 18:06:26,046 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started [email protected]:8088
2014-01-08 18:06:26,046 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.SingleDataSegmentAnnouncer@307c5cac].
2014-01-08 18:06:26,046 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='localhost:8088', host='localhost:8088', maxSize=0, tier='_default_tier', type='indexer-executor'}] at [/druid/announcements/localhost:8088]
2014-01-08 18:06:26,076 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.start()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@14c158c0].
2014-01-08 18:06:26,076 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Announcing self[DruidServerMetadata{name='localhost:8088', host='localhost:8088', maxSize=0, tier='_default_tier', type='indexer-executor'}] at [/druid/announcements/localhost:8088]
2014-01-08 18:06:26,076 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.start()] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@b5af4a7].
2014-01-08 18:06:26,085 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Created new InventoryCacheListener for /druid/servedSegments/localhost:8088
2014-01-08 18:06:26,085 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Starting inventory cache for localhost:8088, inventoryPath /druid/servedSegments/localhost:8088
2014-01-08 18:06:26,085 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - New Server[DruidServerMetadata{name='localhost:8088', host='localhost:8088', maxSize=0, tier='_default_tier', type='indexer-executor'}]
2014-01-08 18:06:26,166 INFO [main] io.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index",
"id" : "index_countriesv8_2014-01-08T18:06:17.332Z",
"dataSource" : "countriesv8",
"granularitySpec" : {
"type" : "uniform",
"gran" : "DAY",
"intervals" : [ "2014-01-01T00:00:00.000Z/2014-01-05T00:00:00.000Z" ]
},
"spatialDimensions" : [ ],
"aggregators" : [ {
"type" : "count",
"name" : "count"
} ],
"indexGranularity" : {
"type" : "none"
},
"targetPartitionSize" : 0,
"firehose" : {
"type" : "local",
"baseDir" : "/Users/parth/temp/druid-services-0.6.39/examples/indexing",
"filter" : "countries.json",
"parser" : {
"type" : "string",
"timestampSpec" : {
"column" : "timestamp",
"format" : "auto"
},
"data" : {
"format" : "json",
"dimensions" : [ "country" ],
"spatialDimensions" : [ ]
},
"dimensionExclusions" : [ "timestamp" ]
}
},
"rowFlushBoundary" : 0,
"groupId" : "index_countriesv8_2014-01-08T18:06:17.332Z",
"interval" : "2014-01-01T00:00:00.000Z/2014-01-05T00:00:00.000Z",
"resource" : {
"availabilityGroup" : "index_countriesv8_2014-01-08T18:06:17.332Z",
"requiredCapacity" : 1
}
}
2014-01-08 18:06:26,168 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_countriesv8_2014-01-08T18:06:17.332Z]: LockTryAcquireAction{interval=2014-01-01T00:00:00.000Z/2014-01-05T00:00:00.000Z}
2014-01-08 18:06:26,174 INFO [main] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_countriesv8_2014-01-08T18:06:17.332Z] to overlord[http://localhost:8087/druid/indexer/v1/action]: LockTryAcquireAction{interval=2014-01-01T00:00:00.000Z/2014-01-05T00:00:00.000Z}
2014-01-08 18:06:26,183 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://localhost:8087
2014-01-08 18:06:26,236 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://localhost:8087
2014-01-08 18:06:26,237 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://localhost:8087
2014-01-08 18:06:26,237 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://localhost:8087
2014-01-08 18:06:26,237 INFO [main] com.metamx.http.client.pool.ChannelResourceFactory - Generating: http://localhost:8087
2014-01-08 18:06:26,272 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Running task: index_countriesv8_2014-01-08T18:06:17.332Z
2014-01-08 18:06:26,272 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_countriesv8_2014-01-08T18:06:17.332Z]: LockListAction{}
2014-01-08 18:06:26,274 INFO [task-runner-0] io.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_countriesv8_2014-01-08T18:06:17.332Z] to overlord[http://localhost:8087/druid/indexer/v1/action]: LockListAction{}
2014-01-08 18:06:26,307 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Spilling index[0] with rows[2] to: /tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0
2014-01-08 18:06:26,311 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting persist for interval[2014-01-01T00:00:00.000Z/2014-01-01T03:00:00.001Z], rows[2]
2014-01-08 18:06:26,324 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0/v8-tmp] completed index.drd in 5 millis.
2014-01-08 18:06:26,338 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0/v8-tmp] completed dim conversions in 14 millis.
2014-01-08 18:06:26,351 INFO [task-runner-0] io.druid.segment.CompressedPools - Allocating new chunkEncoder[1]
2014-01-08 18:06:26,357 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0/v8-tmp] completed walk through of 2 rows in 19 millis.
2014-01-08 18:06:26,358 INFO [task-runner-0] io.druid.segment.IndexMerger - Starting dimension[country] with cardinality[2]
2014-01-08 18:06:26,366 INFO [task-runner-0] io.druid.segment.IndexMerger - Completed dimension[country] in 9 millis.
2014-01-08 18:06:26,366 INFO [task-runner-0] io.druid.segment.IndexMerger - outDir[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0/v8-tmp] completed inverted.drd in 9 millis.
2014-01-08 18:06:26,373 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Converting v8[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0/v8-tmp] to v9[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0]
2014-01-08 18:06:26,374 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[dim_country.drd]
2014-01-08 18:06:26,377 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Dimension[country] is single value, converting...
2014-01-08 18:06:26,385 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[index.drd]
2014-01-08 18:06:26,385 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[inverted.drd]
2014-01-08 18:06:26,385 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[met_count_LITTLE_ENDIAN.drd]
2014-01-08 18:06:26,388 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[spatial.drd]
2014-01-08 18:06:26,388 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Processing file[time_LITTLE_ENDIAN.drd]
2014-01-08 18:06:26,392 INFO [task-runner-0] io.druid.segment.IndexIO$DefaultIndexIOHandler - Skipped files[[index.drd, inverted.drd, spatial.drd]]
2014-01-08 18:06:26,406 INFO [task-runner-0] io.druid.segment.loading.LocalDataSegmentPusher - Compressing files from[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0] to [/tmp/druid/localStorage/countriesv8/2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z/2014-01-08T18:06:17.332Z/0/index.zip]
2014-01-08 18:06:26,407 INFO [task-runner-0] io.druid.utils.CompressionUtils - Adding file[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0/00000.smoosh] with size[563]. Total size so far[0]
2014-01-08 18:06:26,408 INFO [task-runner-0] io.druid.utils.CompressionUtils - Adding file[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0/meta.smoosh] with size[85]. Total size so far[563]
2014-01-08 18:06:26,408 INFO [task-runner-0] io.druid.utils.CompressionUtils - Adding file[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0/version.bin] with size[4]. Total size so far[648]
2014-01-08 18:06:26,410 INFO [task-runner-0] io.druid.segment.loading.LocalDataSegmentPusher - Creating descriptor file at[/tmp/druid/localStorage/countriesv8/2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z/2014-01-08T18:06:17.332Z/0/descriptor.json]
2014-01-08 18:06:26,415 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Uploaded segment[countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z]
2014-01-08 18:06:26,416 INFO [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Deleting Index File[/tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z_0/countriesv8_2014-01-01T00:00:00.000Z_2014-01-02T00:00:00.000Z_2014-01-08T18:06:17.332Z/spill0]
2014-01-08 18:06:26,416 INFO [task-runner-0] io.druid.indexing.common.task.IndexTask - Task[index_countriesv8_2014-01-08T18:06:17.332Z] took in 4 rows (2 processed, 0 unparseable, 2 thrown away) and output 2 rows
2014-01-08 18:06:26,418 WARN [task-runner-0] io.druid.indexing.common.index.YeOldePlumberSchool - Failed to merge and upload
java.lang.IllegalStateException: Nothing indexed?
at io.druid.indexing.common.index.YeOldePlumberSchool$1.finishJob(YeOldePlumberSchool.java:136)
at io.druid.indexing.common.task.IndexTask.generateSegment(IndexTask.java:371)
at io.druid.indexing.common.task.IndexTask.run(IndexTask.java:144)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:216)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:195)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2014-01-08 18:06:26,420 ERROR [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task[IndexTask{id=index_countriesv8_2014-01-08T18:06:17.332Z, type=index, dataSource=countriesv8}]
java.lang.IllegalStateException: Nothing indexed?
at io.druid.indexing.common.index.YeOldePlumberSchool$1.finishJob(YeOldePlumberSchool.java:136)
at io.druid.indexing.common.task.IndexTask.generateSegment(IndexTask.java:371)
at io.druid.indexing.common.task.IndexTask.run(IndexTask.java:144)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:216)
at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:195)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2014-01-08 18:06:26,420 INFO [task-runner-0] io.druid.indexing.overlord.ThreadPoolTaskRunner - Removing task directory: /tmp/persistent/task/index_countriesv8_2014-01-08T18:06:17.332Z/work
2014-01-08 18:06:26,424 INFO [task-runner-0] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_countriesv8_2014-01-08T18:06:17.332Z",
"status" : "FAILED",
"duration" : 149
}
2014-01-08 18:06:26,427 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.BatchDataSegmentAnnouncer@14c158c0].
2014-01-08 18:06:26,427 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.BatchDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig$$EnhancerByCGLIB$$7f4e829e@733e5fb8]
2014-01-08 18:06:26,427 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/localhost:8088]
2014-01-08 18:06:26,430 INFO [ServerInventoryView-0] io.druid.curator.inventory.CuratorInventoryManager - Closing inventory cache for localhost:8088. Also removing listeners.
2014-01-08 18:06:26,431 INFO [ServerInventoryView-0] io.druid.client.SingleServerInventoryView - Server Disappeared[DruidServerMetadata{name='localhost:8088', host='localhost:8088', maxSize=0, tier='_default_tier', type='indexer-executor'}]
2014-01-08 18:06:26,431 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.server.coordination.AbstractDataSegmentAnnouncer.stop()] on object[io.druid.server.coordination.SingleDataSegmentAnnouncer@307c5cac].
2014-01-08 18:06:26,431 INFO [main] io.druid.server.coordination.AbstractDataSegmentAnnouncer - Stopping class io.druid.server.coordination.SingleDataSegmentAnnouncer with config[io.druid.server.initialization.ZkPathsConfig$$EnhancerByCGLIB$$7f4e829e@733e5fb8]
2014-01-08 18:06:26,431 INFO [main] io.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/localhost:8088]
2014-01-08 18:06:26,431 ERROR [main] io.druid.curator.announcement.Announcer - Path[/druid/announcements/localhost:8088] not announced, cannot unannounce.
2014-01-08 18:06:26,431 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.worker.executor.ExecutorLifecycle.stop()] on object[io.druid.indexing.worker.executor.ExecutorLifecycle@b5af4a7].
2014-01-08 18:06:26,455 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - stopped o.e.j.s.ServletContextHandler{/,null}
2014-01-08 18:06:26,455 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - stopped o.e.j.s.ServletContextHandler{/,file:/}
2014-01-08 18:06:26,508 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.indexing.overlord.ThreadPoolTaskRunner.stop()] on object[io.druid.indexing.overlord.ThreadPoolTaskRunner@4c63b66].
2014-01-08 18:06:26,508 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.client.ServerInventoryView.stop() throws java.io.IOException] on object[io.druid.client.SingleServerInventoryView@a1d2332].
2014-01-08 18:06:26,508 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.announcement.Announcer.stop()] on object[io.druid.curator.announcement.Announcer@c923822].
2014-01-08 18:06:26,509 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void io.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[io.druid.curator.discovery.ServerDiscoverySelector@2280cbba].
2014-01-08 18:06:26,509 INFO [main] io.druid.curator.CuratorModule - Stopping Curator
2014-01-08 18:06:26,511 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x14368d9715c0078 closed
2014-01-08 18:06:26,511 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down
2014-01-08 18:06:26,511 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.http.client.HttpClient.stop()] on object[com.metamx.http.client.HttpClient@45d3972c].
2014-01-08 18:06:26,517 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.metrics.MonitorScheduler.stop()] on object[com.metamx.metrics.MonitorScheduler@fe43069].
2014-01-08 18:06:26,517 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.service.ServiceEmitter@59e612eb].
2014-01-08 18:06:26,517 INFO [main] com.metamx.emitter.core.LoggingEmitter - Close: started [false]
2014-01-08 18:06:26,517 INFO [main] com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void com.metamx.emitter.core.LoggingEmitter.close() throws java.io.IOException] on object[com.metamx.emitter.core.LoggingEmitter@5087d5ce].
@parth-patil
Copy link
Author

Following is the input dataset
{"timestamp": "2014-01-01T01:00:00Z", "country": "US"}
{"timestamp": "2014-01-01T03:00:00Z", "country": "CA"}
{"timestamp": "2014-01-03T03:00:00Z", "country": "US"}
{"timestamp": "2014-01-04T04:00:00Z", "country": "US"}

Following is the index task json
{
"type" : "index",
"dataSource" : "countriesv8",
"granularitySpec" : {
"type" : "uniform",
"gran" : "day",
"intervals" : [ "2014-01-01/2014-01-05" ]
},
"aggregators" : [{
"type" : "count",
"name" : "count"
}],
"firehose" : {
"type" : "local",
"baseDir" : "examples/indexing/",
"filter" : "countries.json",
"parser" : {
"timestampSpec" : {
"column" : "timestamp"
},
"data" : {
"format" : "json",
"dimensions" : ["country"]
}
}
}
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment