-
key.jsonexists ingcp-service-accounts/key.jsonwith GCP roles BigQuery Admin and Storage Admin -
local feast repo is checked out to master:
$ git show --oneline -s 99656777 (HEAD -> master, origin/master, origin/HEAD) Wait for docker images to be ready for e2e dataflow test (#909) -
have run
docker pull gcr.io/kf-feast/feast-core docker pull gcr.io/kf-feast/feast-serving
-
-
Save masonlr/38c9931d1e9c6ea2ac0aac6d7d1ad0f6 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # General | |
| COMPOSE_PROJECT_NAME=feast | |
| FEAST_VERSION=latest | |
| FEAST_REPOSITORY_VERSION=v0.5-branch | |
| # Feast Core | |
| FEAST_CORE_IMAGE=gcr.io/kf-feast/feast-core | |
| FEAST_CORE_CONFIG=core.yml | |
| FEAST_CORE_GCP_SERVICE_ACCOUNT_KEY=key.json | |
| # Feast Serving | |
| FEAST_SERVING_IMAGE=gcr.io/kf-feast/feast-serving | |
| # Feast Serving - Batch (BigQuery) | |
| FEAST_BATCH_SERVING_CONFIG=batch-serving.yml | |
| FEAST_BATCH_SERVING_GCP_SERVICE_ACCOUNT_KEY=key.json | |
| # Feast Serving - Online (Redis) | |
| FEAST_ONLINE_SERVING_CONFIG=online-serving.yml | |
| # Jupyter | |
| FEAST_JUPYTER_GCP_SERVICE_ACCOUNT_KEY=key.json |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| feast: | |
| core-host: core | |
| active-store: historical | |
| stores: | |
| - name: historical | |
| type: BIGQUERY | |
| # Changes required for batch serving to work | |
| # Please see https://api.docs.feast.dev/grpc/feast.core.pb.html#Store for configuration options | |
| config: | |
| project_id: project-feast-test | |
| dataset_id: test | |
| staging_location: gs://feast-storage-bucket/test | |
| initial_retry_delay_seconds: 1 | |
| total_timeout_seconds: 21600 | |
| subscriptions: | |
| - name: "*" | |
| project: "*" | |
| job_store: | |
| redis_host: redis | |
| redis_port: 6379 | |
| grpc: | |
| port: 6567 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| feast: | |
| jobs: | |
| polling_interval_milliseconds: 30000 | |
| job_update_timeout_seconds: 240 | |
| active_runner: direct | |
| runners: | |
| - name: direct | |
| type: DirectRunner | |
| options: {} | |
| stream: | |
| type: kafka | |
| options: | |
| topic: feast-features | |
| bootstrapServers: "kafka:9092,localhost:9094" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| version: "3.7" | |
| services: | |
| batch-serving: | |
| image: ${FEAST_SERVING_IMAGE}:${FEAST_VERSION} | |
| volumes: | |
| - ./serving/${FEAST_BATCH_SERVING_CONFIG}:/etc/feast/application.yml | |
| - ./gcp-service-accounts/${FEAST_BATCH_SERVING_GCP_SERVICE_ACCOUNT_KEY}:/etc/gcloud/service-accounts/key.json | |
| depends_on: | |
| - redis | |
| ports: | |
| - 6567:6567 | |
| restart: on-failure | |
| environment: | |
| GOOGLE_APPLICATION_CREDENTIALS: /etc/gcloud/service-accounts/key.json | |
| command: | |
| - "java" | |
| - "-Xms1024m" | |
| - "-Xmx1024m" | |
| - "-jar" | |
| - "/opt/feast/feast-serving.jar" | |
| - "--spring.config.location=classpath:/application.yml,file:/etc/feast/application.yml" | |
| redis: | |
| image: redis:5-alpine | |
| ports: | |
| - "6379:6379" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| version: "3.7" | |
| services: | |
| online-serving: | |
| image: ${FEAST_SERVING_IMAGE}:${FEAST_VERSION} | |
| volumes: | |
| - ./serving/${FEAST_ONLINE_SERVING_CONFIG}:/etc/feast/application.yml | |
| # Required if authentication is enabled on core and | |
| # provider is 'google'. GOOGLE_APPLICATION_CREDENTIALS is used for connecting to core. | |
| - ./gcp-service-accounts/${FEAST_BATCH_SERVING_GCP_SERVICE_ACCOUNT_KEY}:/etc/gcloud/service-accounts/key.json | |
| depends_on: | |
| - redis | |
| ports: | |
| - 6566:6566 | |
| restart: on-failure | |
| environment: | |
| GOOGLE_APPLICATION_CREDENTIALS: /etc/gcloud/service-accounts/key.json | |
| command: | |
| - java | |
| - -jar | |
| - /opt/feast/feast-serving.jar | |
| - --spring.config.location=classpath:/application.yml,file:/etc/feast/application.yml | |
| redis: | |
| image: redis:5-alpine | |
| ports: | |
| - "6379:6379" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| version: "3.7" | |
| services: | |
| core: | |
| image: ${FEAST_CORE_IMAGE}:${FEAST_VERSION} | |
| volumes: | |
| - ./core/${FEAST_CORE_CONFIG}:/etc/feast/application.yml | |
| - ./gcp-service-accounts/${FEAST_CORE_GCP_SERVICE_ACCOUNT_KEY}:/etc/gcloud/service-accounts/key.json | |
| environment: | |
| DB_HOST: db | |
| GOOGLE_APPLICATION_CREDENTIALS: /etc/gcloud/service-accounts/key.json | |
| restart: on-failure | |
| depends_on: | |
| - db | |
| - kafka | |
| ports: | |
| - 6565:6565 | |
| command: | |
| - java | |
| - -jar | |
| - /opt/feast/feast-core.jar | |
| - --spring.config.location=classpath:/application.yml,file:/etc/feast/application.yml | |
| jupyter: | |
| image: gcr.io/kf-feast/feast-jupyter:latest | |
| volumes: | |
| - ./gcp-service-accounts/${FEAST_JUPYTER_GCP_SERVICE_ACCOUNT_KEY}:/etc/gcloud/service-accounts/key.json | |
| depends_on: | |
| - core | |
| environment: | |
| FEAST_CORE_URL: core:6565 | |
| FEAST_ONLINE_SERVING_URL: online-serving:6566 | |
| FEAST_BATCH_SERVING_URL: batch-serving:6567 | |
| GOOGLE_APPLICATION_CREDENTIALS: /etc/gcloud/service-accounts/key.json | |
| ports: | |
| - 8888:8888 | |
| command: > | |
| bash -c " | |
| git clone https://github.com/feast-dev/feast.git || true | |
| && cd feast && git checkout $$(git tag | sort -r --version-sort | head -n1 | cut -c1-4)-branch && cd .. | |
| && start-notebook.sh --NotebookApp.token=''" | |
| kafka: | |
| image: confluentinc/cp-kafka:5.2.1 | |
| environment: | |
| KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181 | |
| KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1 | |
| KAFKA_ADVERTISED_LISTENERS: INSIDE://kafka:9092,OUTSIDE://localhost:9094 | |
| KAFKA_LISTENERS: INSIDE://:9092,OUTSIDE://:9094 | |
| KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: INSIDE:PLAINTEXT,OUTSIDE:PLAINTEXT | |
| KAFKA_INTER_BROKER_LISTENER_NAME: INSIDE | |
| ports: | |
| - "9092:9092" | |
| - "9094:9094" | |
| depends_on: | |
| - zookeeper | |
| zookeeper: | |
| image: confluentinc/cp-zookeeper:5.2.1 | |
| environment: | |
| ZOOKEEPER_CLIENT_PORT: 2181 | |
| db: | |
| image: postgres:12-alpine | |
| environment: | |
| POSTGRES_PASSWORD: password | |
| ports: | |
| - "5432:5432" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance. | |
| ███████╗███████╗ █████╗ ███████╗████████╗ | |
| ██╔════╝██╔════╝██╔══██╗██╔════╝╚══██╔══╝ | |
| █████╗ █████╗ ███████║███████╗ ██║ | |
| ██╔══╝ ██╔══╝ ██╔══██║╚════██║ ██║ | |
| ██║ ███████╗██║ ██║███████║ ██║ | |
| ╚═╝ ╚══════╝╚═╝ ╚═╝╚══════╝ ╚═╝ | |
| ██████╗ ██████╗ ██████╗ ███████╗ | |
| ██╔════╝██╔═══██╗██╔══██╗██╔════╝ | |
| ██║ ██║ ██║██████╔╝█████╗ | |
| ██║ ██║ ██║██╔══██╗██╔══╝ | |
| ╚██████╗╚██████╔╝██║ ██║███████╗ | |
| ╚═════╝ ╚═════╝ ╚═╝ ╚═╝╚══════╝ | |
| 2020-07-30 08:30:19.520 INFO e9aba3435844 --- [ main] f.c.CoreApplication : Starting CoreApplication on e9aba3435844 with PID 1 (/opt/feast/feast-core.jar started by root in /) | |
| 2020-07-30 08:30:19.532 DEBUG e9aba3435844 --- [ main] f.c.CoreApplication : Running with Spring Boot v2.0.9.RELEASE, Spring v5.0.13.RELEASE | |
| 2020-07-30 08:30:19.534 INFO e9aba3435844 --- [ main] f.c.CoreApplication : No active profile set, falling back to default profiles: default | |
| 2020-07-30 08:30:19.736 INFO e9aba3435844 --- [ main] ConfigServletWebServerApplicationContext : Refreshing org.springframework.boot.web.servlet.context.AnnotationConfigServletWebServerApplicationContext@20d7d6fb: startup date [Thu Jul 30 08:30:19 UTC 2020]; root of context hierarchy | |
| 2020-07-30 08:30:23.923 INFO e9aba3435844 --- [ main] f.a.AutowiredAnnotationBeanPostProcessor : JSR-330 'javax.inject.Inject' annotation found and supported for autowiring | |
| 2020-07-30 08:30:24.166 INFO e9aba3435844 --- [ main] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.kafka.annotation.KafkaBootstrapConfiguration' of type [org.springframework.kafka.annotation.KafkaBootstrapConfiguration$$EnhancerBySpringCGLIB$$407d55db] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) | |
| 2020-07-30 08:30:24.270 INFO e9aba3435844 --- [ main] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.transaction.annotation.ProxyTransactionManagementConfiguration' of type [org.springframework.transaction.annotation.ProxyTransactionManagementConfiguration$$EnhancerBySpringCGLIB$$6ccb4458] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) | |
| 2020-07-30 08:30:25.057 INFO e9aba3435844 --- [ main] o.s.b.w.e.t.TomcatWebServer : Tomcat initialized with port(s): 8080 (http) | |
| 2020-07-30 08:30:25.094 INFO e9aba3435844 --- [ main] o.a.c.h.Http11NioProtocol : Initializing ProtocolHandler ["http-nio-8080"] | |
| 2020-07-30 08:30:25.120 INFO e9aba3435844 --- [ main] o.a.c.c.StandardService : Starting service [Tomcat] | |
| 2020-07-30 08:30:25.122 INFO e9aba3435844 --- [ main] o.a.c.c.StandardEngine : Starting Servlet Engine: Apache Tomcat/8.5.39 | |
| 2020-07-30 08:30:25.142 INFO e9aba3435844 --- [ost-startStop-1] o.a.c.c.AprLifecycleListener : The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: [/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib] | |
| 2020-07-30 08:30:25.257 INFO e9aba3435844 --- [ost-startStop-1] o.a.c.c.C.[.[.[/] : Initializing Spring embedded WebApplicationContext | |
| 2020-07-30 08:30:25.258 INFO e9aba3435844 --- [ost-startStop-1] o.s.w.c.ContextLoader : Root WebApplicationContext: initialization completed in 5531 ms | |
| 2020-07-30 08:30:26.432 WARN e9aba3435844 --- [ost-startStop-1] o.f.c.Flyway : Direct configuration of the Flyway object has been deprecated and will be removed in Flyway 6.0. Use Flyway.configure() instead. | |
| 2020-07-30 08:30:26.434 WARN e9aba3435844 --- [ost-startStop-1] o.f.c.Flyway : Direct configuration retrieval from the Flyway object has been deprecated and will be removed in Flyway 6.0. Use Flyway.getConfiguration() instead. | |
| 2020-07-30 08:30:26.435 WARN e9aba3435844 --- [ost-startStop-1] o.f.c.Flyway : Direct configuration retrieval from the Flyway object has been deprecated and will be removed in Flyway 6.0. Use Flyway.getConfiguration() instead. | |
| 2020-07-30 08:30:26.435 WARN e9aba3435844 --- [ost-startStop-1] o.f.c.Flyway : Direct configuration of the Flyway object has been deprecated and will be removed in Flyway 6.0. Use Flyway.configure() instead. | |
| 2020-07-30 08:30:26.486 WARN e9aba3435844 --- [ost-startStop-1] o.f.c.Flyway : Direct configuration of the Flyway object has been deprecated and will be removed in Flyway 6.0. Use Flyway.configure() instead. | |
| 2020-07-30 08:30:26.533 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.l.VersionPrinter : Flyway Community Edition 5.2.4 by Boxfuse | |
| 2020-07-30 08:30:26.580 INFO e9aba3435844 --- [ost-startStop-1] c.z.h.HikariDataSource : HikariPool-1 - Starting... | |
| 2020-07-30 08:30:26.795 INFO e9aba3435844 --- [ost-startStop-1] c.z.h.HikariDataSource : HikariPool-1 - Start completed. | |
| 2020-07-30 08:30:26.809 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.d.DatabaseFactory : Database: jdbc:postgresql://db:5432/postgres (PostgreSQL 12.3) | |
| 2020-07-30 08:30:26.828 WARN e9aba3435844 --- [ost-startStop-1] o.f.c.i.d.b.Database : Flyway upgrade recommended: PostgreSQL 12.3 is newer than this version of Flyway and support has not been tested. | |
| 2020-07-30 08:30:26.964 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.c.DbValidate : Successfully validated 7 migrations (execution time 00:00.051s) | |
| 2020-07-30 08:30:26.991 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.s.JdbcTableSchemaHistory : Creating Schema History table: "public"."flyway_schema_history" | |
| 2020-07-30 08:30:27.034 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Current version of schema "public": << Empty Schema >> | |
| 2020-07-30 08:30:27.036 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 1 - Baseline | |
| 2020-07-30 08:30:27.119 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2 - RELEASE 0.6 Generalizing Source AND Extending FeatureSetJobStatus AND Feature Statistics | |
| 2020-07-30 08:30:27.168 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2.1 - Many Stores Per Job | |
| 2020-07-30 08:30:27.185 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2.2 - Subscription Migration | |
| 2020-07-30 08:30:27.196 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2.3 - Fix Primary Keys | |
| 2020-07-30 08:30:27.209 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2.4 - Store proto | |
| 2020-07-30 08:30:27.219 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2.5 - Fix Subscription MIgration | |
| 2020-07-30 08:30:27.231 INFO e9aba3435844 --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Successfully applied 7 migrations to schema "public" (execution time 00:00.241s) | |
| 2020-07-30 08:30:27.747 INFO e9aba3435844 --- [ost-startStop-1] j.LocalContainerEntityManagerFactoryBean : Building JPA container EntityManagerFactory for persistence unit 'default' | |
| 2020-07-30 08:30:27.795 INFO e9aba3435844 --- [ost-startStop-1] o.h.j.i.u.LogHelper : HHH000204: Processing PersistenceUnitInfo [ | |
| name: default | |
| ...] | |
| 2020-07-30 08:30:28.064 INFO e9aba3435844 --- [ost-startStop-1] o.h.Version : HHH000412: Hibernate Core {5.3.6.Final} | |
| 2020-07-30 08:30:28.071 INFO e9aba3435844 --- [ost-startStop-1] o.h.c.Environment : HHH000206: hibernate.properties not found | |
| 2020-07-30 08:30:28.744 INFO e9aba3435844 --- [ost-startStop-1] o.h.a.c.Version : HCANN000001: Hibernate Commons Annotations {5.0.4.Final} | |
| 2020-07-30 08:30:29.678 INFO e9aba3435844 --- [ost-startStop-1] o.h.d.Dialect : HHH000400: Using dialect: org.hibernate.dialect.PostgreSQL95Dialect | |
| 2020-07-30 08:30:29.862 INFO e9aba3435844 --- [ost-startStop-1] o.h.e.j.e.i.LobCreatorBuilderImpl : HHH000424: Disabling contextual LOB creation as createClob() method threw error : java.lang.reflect.InvocationTargetException | |
| 2020-07-30 08:30:29.874 INFO e9aba3435844 --- [ost-startStop-1] o.h.t.BasicTypeRegistry : HHH000270: Type registration [java.util.UUID] overrides previous : org.hibernate.type.UUIDBinaryType@2f7e345b | |
| 2020-07-30 08:30:31.547 INFO e9aba3435844 --- [ost-startStop-1] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' | |
| 2020-07-30 08:30:32.615 INFO e9aba3435844 --- [ost-startStop-1] o.h.h.i.QueryTranslatorFactoryInitiator : HHH000397: Using ASTQueryTranslatorFactory | |
| 2020-07-30 08:30:33.470 INFO e9aba3435844 --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'characterEncodingFilter' to: [/*] | |
| 2020-07-30 08:30:33.470 INFO e9aba3435844 --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'webMvcMetricsFilter' to: [/*] | |
| 2020-07-30 08:30:33.470 INFO e9aba3435844 --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'hiddenHttpMethodFilter' to: [/*] | |
| 2020-07-30 08:30:33.471 INFO e9aba3435844 --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'httpPutFormContentFilter' to: [/*] | |
| 2020-07-30 08:30:33.471 INFO e9aba3435844 --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'requestContextFilter' to: [/*] | |
| 2020-07-30 08:30:33.471 INFO e9aba3435844 --- [ost-startStop-1] .s.DelegatingFilterProxyRegistrationBean : Mapping filter: 'springSecurityFilterChain' to: [/*] | |
| 2020-07-30 08:30:33.471 INFO e9aba3435844 --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'httpTraceFilter' to: [/*] | |
| 2020-07-30 08:30:33.472 INFO e9aba3435844 --- [ost-startStop-1] o.s.b.w.s.ServletRegistrationBean : Servlet metricsServlet mapped to [/metrics] | |
| 2020-07-30 08:30:33.477 INFO e9aba3435844 --- [ost-startStop-1] o.s.b.w.s.ServletRegistrationBean : Servlet dispatcherServlet mapped to [/] | |
| 2020-07-30 08:30:33.972 INFO e9aba3435844 --- [ main] .s.s.UserDetailsServiceAutoConfiguration : | |
| Using generated security password: 614bad70-4d59-47e1-8c2d-194453e5275b | |
| 2020-07-30 08:30:34.282 INFO e9aba3435844 --- [ main] o.s.s.w.DefaultSecurityFilterChain : Creating filter chain: any request, [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@a565cbd, org.springframework.security.web.context.SecurityContextPersistenceFilter@481e91b6, org.springframework.security.web.header.HeaderWriterFilter@1daf3b44, org.springframework.security.web.authentication.logout.LogoutFilter@6f139fc9, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@3cbf1ba4, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@383864d5, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@6fc29daa, org.springframework.security.web.session.SessionManagementFilter@8a2a6a, org.springframework.security.web.access.ExceptionTranslationFilter@3ee69ad8, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@3cb8c8ce] | |
| 2020-07-30 08:30:34.542 INFO e9aba3435844 --- [ main] o.s.w.s.h.SimpleUrlHandlerMapping : Mapped URL path [/**/favicon.ico] onto handler of type [class org.springframework.web.servlet.resource.ResourceHttpRequestHandler] | |
| 2020-07-30 08:30:34.827 INFO e9aba3435844 --- [ main] s.w.s.m.m.a.RequestMappingHandlerAdapter : Looking for @ControllerAdvice: org.springframework.boot.web.servlet.context.AnnotationConfigServletWebServerApplicationContext@20d7d6fb: startup date [Thu Jul 30 08:30:19 UTC 2020]; root of context hierarchy | |
| 2020-07-30 08:30:34.911 WARN e9aba3435844 --- [ main] aWebConfiguration$JpaWebMvcConfiguration : spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning | |
| 2020-07-30 08:30:34.974 INFO e9aba3435844 --- [ main] s.w.s.m.m.a.RequestMappingHandlerMapping : Mapped "{[/error],produces=[text/html]}" onto public org.springframework.web.servlet.ModelAndView org.springframework.boot.autoconfigure.web.servlet.error.BasicErrorController.errorHtml(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) | |
| 2020-07-30 08:30:34.977 INFO e9aba3435844 --- [ main] s.w.s.m.m.a.RequestMappingHandlerMapping : Mapped "{[/error]}" onto public org.springframework.http.ResponseEntity<java.util.Map<java.lang.String, java.lang.Object>> org.springframework.boot.autoconfigure.web.servlet.error.BasicErrorController.error(javax.servlet.http.HttpServletRequest) | |
| 2020-07-30 08:30:35.029 INFO e9aba3435844 --- [ main] o.s.w.s.h.SimpleUrlHandlerMapping : Mapped URL path [/webjars/**] onto handler of type [class org.springframework.web.servlet.resource.ResourceHttpRequestHandler] | |
| 2020-07-30 08:30:35.029 INFO e9aba3435844 --- [ main] o.s.w.s.h.SimpleUrlHandlerMapping : Mapped URL path [/**] onto handler of type [class org.springframework.web.servlet.resource.ResourceHttpRequestHandler] | |
| 2020-07-30 08:30:36.031 INFO e9aba3435844 --- [ main] o.s.b.a.e.w.EndpointLinksResolver : Exposing 2 endpoint(s) beneath base path '/actuator' | |
| 2020-07-30 08:30:36.052 INFO e9aba3435844 --- [ main] s.b.a.e.w.s.WebMvcEndpointHandlerMapping : Mapped "{[/actuator/health],methods=[GET],produces=[application/vnd.spring-boot.actuator.v2+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.web.servlet.AbstractWebMvcEndpointHandlerMapping$OperationHandler.handle(javax.servlet.http.HttpServletRequest,java.util.Map<java.lang.String, java.lang.String>) | |
| 2020-07-30 08:30:36.054 INFO e9aba3435844 --- [ main] s.b.a.e.w.s.WebMvcEndpointHandlerMapping : Mapped "{[/actuator/info],methods=[GET],produces=[application/vnd.spring-boot.actuator.v2+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.web.servlet.AbstractWebMvcEndpointHandlerMapping$OperationHandler.handle(javax.servlet.http.HttpServletRequest,java.util.Map<java.lang.String, java.lang.String>) | |
| 2020-07-30 08:30:36.055 INFO e9aba3435844 --- [ main] s.b.a.e.w.s.WebMvcEndpointHandlerMapping : Mapped "{[/actuator],methods=[GET],produces=[application/vnd.spring-boot.actuator.v2+json || application/json]}" onto protected java.util.Map<java.lang.String, java.util.Map<java.lang.String, org.springframework.boot.actuate.endpoint.web.Link>> org.springframework.boot.actuate.endpoint.web.servlet.WebMvcEndpointHandlerMapping.links(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) | |
| 2020-07-30 08:30:36.233 INFO e9aba3435844 --- [ main] o.a.k.c.a.AdminClientConfig : AdminClientConfig values: | |
| bootstrap.servers = [kafka:9092, localhost:9094] | |
| client.dns.lookup = default | |
| client.id = | |
| connections.max.idle.ms = 300000 | |
| metadata.max.age.ms = 300000 | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| receive.buffer.bytes = 65536 | |
| reconnect.backoff.max.ms = 1000 | |
| reconnect.backoff.ms = 50 | |
| request.timeout.ms = 15000 | |
| retries = 5 | |
| retry.backoff.ms = 100 | |
| sasl.client.callback.handler.class = null | |
| sasl.jaas.config = null | |
| sasl.kerberos.kinit.cmd = /usr/bin/kinit | |
| sasl.kerberos.min.time.before.relogin = 60000 | |
| sasl.kerberos.service.name = null | |
| sasl.kerberos.ticket.renew.jitter = 0.05 | |
| sasl.kerberos.ticket.renew.window.factor = 0.8 | |
| sasl.login.callback.handler.class = null | |
| sasl.login.class = null | |
| sasl.login.refresh.buffer.seconds = 300 | |
| sasl.login.refresh.min.period.seconds = 60 | |
| sasl.login.refresh.window.factor = 0.8 | |
| sasl.login.refresh.window.jitter = 0.05 | |
| sasl.mechanism = GSSAPI | |
| security.protocol = PLAINTEXT | |
| send.buffer.bytes = 131072 | |
| ssl.cipher.suites = null | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLS | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| 2020-07-30 08:30:36.339 INFO e9aba3435844 --- [ main] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0 | |
| 2020-07-30 08:30:36.340 INFO e9aba3435844 --- [ main] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a | |
| 2020-07-30 08:30:36.340 INFO e9aba3435844 --- [ main] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596097836337 | |
| 2020-07-30 08:30:36.403 WARN e9aba3435844 --- [| adminclient-1] o.a.k.c.NetworkClient : [AdminClient clientId=adminclient-1] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available. | |
| 2020-07-30 08:30:37.058 ERROR e9aba3435844 --- [ main] o.s.k.c.KafkaAdmin : Failed to create topics | |
| org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 1. | |
| 2020-07-30 08:30:37.069 INFO e9aba3435844 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup | |
| 2020-07-30 08:30:37.082 INFO e9aba3435844 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Bean with name 'dataSource' has been autodetected for JMX exposure | |
| 2020-07-30 08:30:37.117 INFO e9aba3435844 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Located MBean 'dataSource': registering with JMX server as MBean [com.zaxxer.hikari:name=dataSource,type=HikariDataSource] | |
| 2020-07-30 08:30:37.216 INFO e9aba3435844 --- [ main] o.s.c.s.DefaultLifecycleProcessor : Starting beans in phase 2147483547 | |
| 2020-07-30 08:30:37.247 INFO e9aba3435844 --- [ main] o.a.k.c.c.ConsumerConfig : ConsumerConfig values: | |
| allow.auto.create.topics = true | |
| auto.commit.interval.ms = 5000 | |
| auto.offset.reset = latest | |
| bootstrap.servers = [kafka:9092, localhost:9094] | |
| check.crcs = true | |
| client.dns.lookup = default | |
| client.id = | |
| client.rack = | |
| connections.max.idle.ms = 540000 | |
| default.api.timeout.ms = 60000 | |
| enable.auto.commit = true | |
| exclude.internal.topics = true | |
| fetch.max.bytes = 52428800 | |
| fetch.max.wait.ms = 500 | |
| fetch.min.bytes = 1 | |
| group.id = core-service-null | |
| group.instance.id = null | |
| heartbeat.interval.ms = 3000 | |
| interceptor.classes = [] | |
| internal.leave.group.on.close = true | |
| isolation.level = read_uncommitted | |
| key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer | |
| max.partition.fetch.bytes = 1048576 | |
| max.poll.interval.ms = 300000 | |
| max.poll.records = 500 | |
| metadata.max.age.ms = 300000 | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] | |
| receive.buffer.bytes = 65536 | |
| reconnect.backoff.max.ms = 1000 | |
| reconnect.backoff.ms = 50 | |
| request.timeout.ms = 30000 | |
| retry.backoff.ms = 100 | |
| sasl.client.callback.handler.class = null | |
| sasl.jaas.config = null | |
| sasl.kerberos.kinit.cmd = /usr/bin/kinit | |
| sasl.kerberos.min.time.before.relogin = 60000 | |
| sasl.kerberos.service.name = null | |
| sasl.kerberos.ticket.renew.jitter = 0.05 | |
| sasl.kerberos.ticket.renew.window.factor = 0.8 | |
| sasl.login.callback.handler.class = null | |
| sasl.login.class = null | |
| sasl.login.refresh.buffer.seconds = 300 | |
| sasl.login.refresh.min.period.seconds = 60 | |
| sasl.login.refresh.window.factor = 0.8 | |
| sasl.login.refresh.window.jitter = 0.05 | |
| sasl.mechanism = GSSAPI | |
| security.protocol = PLAINTEXT | |
| send.buffer.bytes = 131072 | |
| session.timeout.ms = 10000 | |
| ssl.cipher.suites = null | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLS | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| value.deserializer = class feast.core.util.KafkaSerialization$ProtoDeserializer | |
| 2020-07-30 08:30:37.329 INFO e9aba3435844 --- [ main] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0 | |
| 2020-07-30 08:30:37.329 INFO e9aba3435844 --- [ main] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a | |
| 2020-07-30 08:30:37.329 INFO e9aba3435844 --- [ main] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596097837329 | |
| 2020-07-30 08:30:37.335 INFO e9aba3435844 --- [ main] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-1, groupId=core-service-null] Subscribed to topic(s): feast-specs-ack | |
| 2020-07-30 08:30:37.344 INFO e9aba3435844 --- [ main] o.s.s.c.ThreadPoolTaskScheduler : Initializing ExecutorService | |
| 2020-07-30 08:30:37.353 INFO e9aba3435844 --- [ main] o.s.c.s.DefaultLifecycleProcessor : Starting beans in phase 2147483647 | |
| 2020-07-30 08:30:37.430 INFO e9aba3435844 --- [ main] n.d.b.g.s.s.AbstractGrpcServerFactory : Registered gRPC service: feast.core.CoreService, bean: coreServiceImpl, class: feast.core.grpc.CoreServiceImpl | |
| 2020-07-30 08:30:37.435 INFO e9aba3435844 --- [ main] n.d.b.g.s.s.AbstractGrpcServerFactory : Registered gRPC service: grpc.health.v1.Health, bean: healthServiceImpl, class: feast.core.grpc.HealthServiceImpl | |
| 2020-07-30 08:30:37.446 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.a.k.c.Metadata : [Consumer clientId=consumer-1, groupId=core-service-null] Cluster ID: -nXps87PTrae9wy6VeJA6g | |
| 2020-07-30 08:30:37.900 INFO e9aba3435844 --- [ main] n.d.b.g.s.s.GrpcServerLifecycle : gRPC Server started, listening on address: *, port: 6565 | |
| 2020-07-30 08:30:37.953 INFO e9aba3435844 --- [ main] s.a.ScheduledAnnotationBeanPostProcessor : No TaskScheduler/ScheduledExecutorService bean found for scheduled processing | |
| 2020-07-30 08:30:37.980 INFO e9aba3435844 --- [ main] o.a.c.h.Http11NioProtocol : Starting ProtocolHandler ["http-nio-8080"] | |
| 2020-07-30 08:30:37.983 INFO e9aba3435844 --- [ main] o.a.t.u.n.NioSelectorPool : Using a shared selector for servlet write/read | |
| 2020-07-30 08:30:37.985 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:30:38.105 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found. | |
| 2020-07-30 08:30:38.143 INFO e9aba3435844 --- [ main] o.s.b.w.e.t.TomcatWebServer : Tomcat started on port(s): 8080 (http) with context path '' | |
| 2020-07-30 08:30:38.149 INFO e9aba3435844 --- [ main] f.c.CoreApplication : Started CoreApplication in 20.158 seconds (JVM running for 22.875) | |
| 2020-07-30 08:30:38.739 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] Discovered group coordinator kafka:9092 (id: 2147482646 rack: null) | |
| 2020-07-30 08:30:38.744 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.a.k.c.c.i.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] Revoking previously assigned partitions [] | |
| 2020-07-30 08:30:38.744 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions revoked: [] | |
| 2020-07-30 08:30:38.744 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] (Re-)joining group | |
| 2020-07-30 08:30:38.777 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] (Re-)joining group | |
| 2020-07-30 08:30:41.835 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] Successfully joined group with generation 1 | |
| 2020-07-30 08:30:41.839 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.a.k.c.c.i.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] Setting newly assigned partitions: feast-specs-ack-0 | |
| 2020-07-30 08:30:41.849 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.a.k.c.c.i.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] Found no committed offset for partition feast-specs-ack-0 | |
| 2020-07-30 08:30:41.862 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-1, groupId=core-service-null] Resetting offset for partition feast-specs-ack-0 to offset 0. | |
| 2020-07-30 08:30:41.864 INFO e9aba3435844 --- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions assigned: [feast-specs-ack-0] | |
| 2020-07-30 08:31:08.112 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:31:08.128 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found. | |
| 2020-07-30 08:31:38.133 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:31:38.143 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found. | |
| 2020-07-30 08:32:08.145 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:32:08.166 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs... | |
| 2020-07-30 08:32:08.170 AUDIT e9aba3435844 --- [pool-4-thread-1] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-online-1596097928157, resource=JOB, timestamp=Thu Jul 30 08:32:08 UTC 2020} | |
| 2020-07-30 08:32:08.170 AUDIT e9aba3435844 --- [pool-4-thread-2] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-historical-1596097928163, resource=JOB, timestamp=Thu Jul 30 08:32:08 UTC 2020} | |
| 2020-07-30 08:32:09.058 INFO e9aba3435844 --- [pool-4-thread-2] f.i.ImportJob : Starting import job with settings: | |
| Current Settings: | |
| appName: DirectRunnerJobManager | |
| blockOnRun: false | |
| defaultFeastProject: default | |
| enforceEncodability: true | |
| enforceImmutability: true | |
| gcsPerformanceMetrics: false | |
| jobName: kafka-2111741832-to-historical-1596097928163 | |
| optionsId: 0 | |
| project: | |
| runner: class org.apache.beam.runners.direct.DirectRunner | |
| sourceJson: { | |
| "type": "KAFKA", | |
| "kafkaSourceConfig": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-features" | |
| } | |
| } | |
| specsStreamingUpdateConfigJson: { | |
| "source": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs" | |
| }, | |
| "ack": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs-ack" | |
| } | |
| } | |
| stableUniqueNames: WARNING | |
| storesJson: [{ | |
| "name": "historical", | |
| "type": "BIGQUERY", | |
| "subscriptions": [{ | |
| "name": "*", | |
| "project": "*" | |
| }], | |
| "bigqueryConfig": { | |
| "projectId": "project-feast-test", | |
| "datasetId": "test", | |
| "stagingLocation": "gs://feast-storage-bucket/test", | |
| "initialRetryDelaySeconds": 1, | |
| "totalTimeoutSeconds": 21600 | |
| } | |
| }] | |
| 2020-07-30 08:32:09.058 INFO e9aba3435844 --- [pool-4-thread-1] f.i.ImportJob : Starting import job with settings: | |
| Current Settings: | |
| appName: DirectRunnerJobManager | |
| blockOnRun: false | |
| defaultFeastProject: default | |
| enforceEncodability: true | |
| enforceImmutability: true | |
| gcsPerformanceMetrics: false | |
| jobName: kafka-2111741832-to-online-1596097928157 | |
| optionsId: 1 | |
| project: | |
| runner: class org.apache.beam.runners.direct.DirectRunner | |
| sourceJson: { | |
| "type": "KAFKA", | |
| "kafkaSourceConfig": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-features" | |
| } | |
| } | |
| specsStreamingUpdateConfigJson: { | |
| "source": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs" | |
| }, | |
| "ack": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs-ack" | |
| } | |
| } | |
| stableUniqueNames: WARNING | |
| storesJson: [{ | |
| "name": "online", | |
| "type": "REDIS", | |
| "subscriptions": [{ | |
| "name": "*", | |
| "project": "*" | |
| }], | |
| "redisConfig": { | |
| "host": "redis", | |
| "port": 6379 | |
| } | |
| }] | |
| 2020-07-30 08:32:09.538 ERROR e9aba3435844 --- [pool-4-thread-1] f.c.j.d.DirectRunnerJobManager : Error submitting job | |
| java.util.ConcurrentModificationException | |
| at java.base/java.util.HashMap.computeIfAbsent(Unknown Source) | |
| at org.apache.beam.sdk.schemas.utils.ReflectUtils.getMethods(ReflectUtils.java:77) | |
| at org.apache.beam.sdk.schemas.AutoValueSchema$AbstractGetterTypeSupplier.get(AutoValueSchema.java:46) | |
| at org.apache.beam.sdk.schemas.utils.StaticSchemaInference.schemaFromClass(StaticSchemaInference.java:83) | |
| at org.apache.beam.sdk.schemas.utils.JavaBeanUtils.schemaFromJavaBeanClass(JavaBeanUtils.java:63) | |
| at org.apache.beam.sdk.schemas.AutoValueSchema.schemaFor(AutoValueSchema.java:114) | |
| at org.apache.beam.sdk.schemas.annotations.DefaultSchema$DefaultSchemaProvider.schemaFor(DefaultSchema.java:131) | |
| at org.apache.beam.sdk.schemas.SchemaRegistry.lambda$getSchema$0(SchemaRegistry.java:256) | |
| at org.apache.beam.sdk.schemas.SchemaRegistry.getProviderResult(SchemaRegistry.java:239) | |
| at org.apache.beam.sdk.schemas.SchemaRegistry.getSchema(SchemaRegistry.java:256) | |
| at org.apache.beam.sdk.values.PCollection.inferCoderOrFail(PCollection.java:159) | |
| at org.apache.beam.sdk.values.PCollection.finishSpecifyingOutput(PCollection.java:94) | |
| at org.apache.beam.sdk.runners.TransformHierarchy.setOutput(TransformHierarchy.java:210) | |
| at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:540) | |
| at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490) | |
| at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:368) | |
| at feast.ingestion.transform.ReadFromSource.expand(ReadFromSource.java:91) | |
| at feast.ingestion.transform.ReadFromSource.expand(ReadFromSource.java:37) | |
| at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:539) | |
| at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490) | |
| at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:56) | |
| at org.apache.beam.sdk.Pipeline.apply(Pipeline.java:184) | |
| at feast.ingestion.ImportJob.runPipeline(ImportJob.java:117) | |
| at feast.core.job.direct.DirectRunnerJobManager.runPipeline(DirectRunnerJobManager.java:164) | |
| at feast.core.job.direct.DirectRunnerJobManager.startJob(DirectRunnerJobManager.java:83) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:48) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:29) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) | |
| at java.base/java.lang.Thread.run(Unknown Source) | |
| 2020-07-30 08:32:09.539 ERROR e9aba3435844 --- [pool-4-thread-1] f.c.j.CreateJobTask : Error running ingestion job: java.util.ConcurrentModificationException | |
| 2020-07-30 08:32:09.539 AUDIT e9aba3435844 --- [pool-4-thread-1] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job failed to be submitted to runner DirectRunner. Job status changed to ERROR., id=kafka-2111741832-to-online-1596097928157, resource=JOB, timestamp=Thu Jul 30 08:32:09 UTC 2020} | |
| 2020-07-30 08:32:09.621 ERROR e9aba3435844 --- [pool-4-thread-2] f.c.j.d.DirectRunnerJobManager : Error submitting job | |
| java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.<init>(FixedWindows.java:65) | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.of(FixedWindows.java:50) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:135) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:49) | |
| at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:539) | |
| at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490) | |
| at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:368) | |
| at feast.ingestion.ImportJob.runPipeline(ImportJob.java:167) | |
| at feast.core.job.direct.DirectRunnerJobManager.runPipeline(DirectRunnerJobManager.java:164) | |
| at feast.core.job.direct.DirectRunnerJobManager.startJob(DirectRunnerJobManager.java:83) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:48) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:29) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) | |
| at java.base/java.lang.Thread.run(Unknown Source) | |
| 2020-07-30 08:32:09.621 ERROR e9aba3435844 --- [pool-4-thread-2] f.c.j.CreateJobTask : Error running ingestion job: java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| 2020-07-30 08:32:09.621 AUDIT e9aba3435844 --- [pool-4-thread-2] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job failed to be submitted to runner DirectRunner. Job status changed to ERROR., id=kafka-2111741832-to-historical-1596097928163, resource=JOB, timestamp=Thu Jul 30 08:32:09 UTC 2020} | |
| 2020-07-30 08:32:39.644 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:32:39.661 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs... | |
| 2020-07-30 08:32:39.661 AUDIT e9aba3435844 --- [pool-5-thread-1] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-online-1596097959656, resource=JOB, timestamp=Thu Jul 30 08:32:39 UTC 2020} | |
| 2020-07-30 08:32:39.661 AUDIT e9aba3435844 --- [pool-5-thread-2] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-historical-1596097959658, resource=JOB, timestamp=Thu Jul 30 08:32:39 UTC 2020} | |
| 2020-07-30 08:32:39.665 INFO e9aba3435844 --- [pool-5-thread-2] f.i.ImportJob : Starting import job with settings: | |
| Current Settings: | |
| appName: DirectRunnerJobManager | |
| blockOnRun: false | |
| defaultFeastProject: default | |
| enforceEncodability: true | |
| enforceImmutability: true | |
| gcsPerformanceMetrics: false | |
| jobName: kafka-2111741832-to-historical-1596097959658 | |
| optionsId: 3 | |
| project: | |
| runner: class org.apache.beam.runners.direct.DirectRunner | |
| sourceJson: { | |
| "type": "KAFKA", | |
| "kafkaSourceConfig": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-features" | |
| } | |
| } | |
| specsStreamingUpdateConfigJson: { | |
| "source": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs" | |
| }, | |
| "ack": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs-ack" | |
| } | |
| } | |
| stableUniqueNames: WARNING | |
| storesJson: [{ | |
| "name": "historical", | |
| "type": "BIGQUERY", | |
| "subscriptions": [{ | |
| "name": "*", | |
| "project": "*" | |
| }], | |
| "bigqueryConfig": { | |
| "projectId": "project-feast-test", | |
| "datasetId": "test", | |
| "stagingLocation": "gs://feast-storage-bucket/test", | |
| "initialRetryDelaySeconds": 1, | |
| "totalTimeoutSeconds": 21600 | |
| } | |
| }] | |
| 2020-07-30 08:32:39.665 INFO e9aba3435844 --- [pool-5-thread-1] f.i.ImportJob : Starting import job with settings: | |
| Current Settings: | |
| appName: DirectRunnerJobManager | |
| blockOnRun: false | |
| defaultFeastProject: default | |
| enforceEncodability: true | |
| enforceImmutability: true | |
| gcsPerformanceMetrics: false | |
| jobName: kafka-2111741832-to-online-1596097959656 | |
| optionsId: 2 | |
| project: | |
| runner: class org.apache.beam.runners.direct.DirectRunner | |
| sourceJson: { | |
| "type": "KAFKA", | |
| "kafkaSourceConfig": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-features" | |
| } | |
| } | |
| specsStreamingUpdateConfigJson: { | |
| "source": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs" | |
| }, | |
| "ack": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs-ack" | |
| } | |
| } | |
| stableUniqueNames: WARNING | |
| storesJson: [{ | |
| "name": "online", | |
| "type": "REDIS", | |
| "subscriptions": [{ | |
| "name": "*", | |
| "project": "*" | |
| }], | |
| "redisConfig": { | |
| "host": "redis", | |
| "port": 6379 | |
| } | |
| }] | |
| 2020-07-30 08:32:39.694 ERROR e9aba3435844 --- [pool-5-thread-2] f.c.j.d.DirectRunnerJobManager : Error submitting job | |
| java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.<init>(FixedWindows.java:65) | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.of(FixedWindows.java:50) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:135) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:49) | |
| at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:539) | |
| at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490) | |
| at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:368) | |
| at feast.ingestion.ImportJob.runPipeline(ImportJob.java:167) | |
| at feast.core.job.direct.DirectRunnerJobManager.runPipeline(DirectRunnerJobManager.java:164) | |
| at feast.core.job.direct.DirectRunnerJobManager.startJob(DirectRunnerJobManager.java:83) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:48) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:29) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) | |
| at java.base/java.lang.Thread.run(Unknown Source) | |
| 2020-07-30 08:32:39.694 ERROR e9aba3435844 --- [pool-5-thread-2] f.c.j.CreateJobTask : Error running ingestion job: java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| 2020-07-30 08:32:39.694 AUDIT e9aba3435844 --- [pool-5-thread-2] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job failed to be submitted to runner DirectRunner. Job status changed to ERROR., id=kafka-2111741832-to-historical-1596097959658, resource=JOB, timestamp=Thu Jul 30 08:32:39 UTC 2020} | |
| 2020-07-30 08:32:39.902 INFO e9aba3435844 --- [pool-5-thread-1] i.l.c.EpollProvider : Starting without optional epoll library | |
| 2020-07-30 08:32:39.904 INFO e9aba3435844 --- [pool-5-thread-1] i.l.c.KqueueProvider : Starting without optional kqueue library | |
| 2020-07-30 08:32:40.665 INFO e9aba3435844 --- [pool-5-thread-1] o.a.k.c.c.ConsumerConfig : ConsumerConfig values: | |
| allow.auto.create.topics = true | |
| auto.commit.interval.ms = 5000 | |
| auto.offset.reset = latest | |
| bootstrap.servers = [kafka:9092, localhost:9094] | |
| check.crcs = true | |
| client.dns.lookup = default | |
| client.id = | |
| client.rack = | |
| connections.max.idle.ms = 540000 | |
| default.api.timeout.ms = 60000 | |
| enable.auto.commit = false | |
| exclude.internal.topics = true | |
| fetch.max.bytes = 52428800 | |
| fetch.max.wait.ms = 500 | |
| fetch.min.bytes = 1 | |
| group.id = feast_import_job_kafka-2111741832-to-online | |
| group.instance.id = null | |
| heartbeat.interval.ms = 3000 | |
| interceptor.classes = [] | |
| internal.leave.group.on.close = true | |
| isolation.level = read_committed | |
| key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| max.partition.fetch.bytes = 1048576 | |
| max.poll.interval.ms = 300000 | |
| max.poll.records = 500 | |
| metadata.max.age.ms = 300000 | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] | |
| receive.buffer.bytes = 524288 | |
| reconnect.backoff.max.ms = 1000 | |
| reconnect.backoff.ms = 50 | |
| request.timeout.ms = 30000 | |
| retry.backoff.ms = 100 | |
| sasl.client.callback.handler.class = null | |
| sasl.jaas.config = null | |
| sasl.kerberos.kinit.cmd = /usr/bin/kinit | |
| sasl.kerberos.min.time.before.relogin = 60000 | |
| sasl.kerberos.service.name = null | |
| sasl.kerberos.ticket.renew.jitter = 0.05 | |
| sasl.kerberos.ticket.renew.window.factor = 0.8 | |
| sasl.login.callback.handler.class = null | |
| sasl.login.class = null | |
| sasl.login.refresh.buffer.seconds = 300 | |
| sasl.login.refresh.min.period.seconds = 60 | |
| sasl.login.refresh.window.factor = 0.8 | |
| sasl.login.refresh.window.jitter = 0.05 | |
| sasl.mechanism = GSSAPI | |
| security.protocol = PLAINTEXT | |
| send.buffer.bytes = 131072 | |
| session.timeout.ms = 10000 | |
| ssl.cipher.suites = null | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLS | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| 2020-07-30 08:32:40.670 INFO e9aba3435844 --- [pool-5-thread-1] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0 | |
| 2020-07-30 08:32:40.670 INFO e9aba3435844 --- [pool-5-thread-1] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a | |
| 2020-07-30 08:32:40.670 INFO e9aba3435844 --- [pool-5-thread-1] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596097960669 | |
| 2020-07-30 08:32:40.672 WARN e9aba3435844 --- [pool-5-thread-1] o.a.k.c.NetworkClient : [Consumer clientId=consumer-2, groupId=feast_import_job_kafka-2111741832-to-online] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available. | |
| 2020-07-30 08:32:40.779 INFO e9aba3435844 --- [pool-5-thread-1] o.a.k.c.Metadata : [Consumer clientId=consumer-2, groupId=feast_import_job_kafka-2111741832-to-online] Cluster ID: -nXps87PTrae9wy6VeJA6g | |
| 2020-07-30 08:32:40.783 INFO e9aba3435844 --- [pool-5-thread-1] o.a.b.s.i.k.KafkaUnboundedSource : Partitions assigned to split 0 (total 1): feast-features-0 | |
| 2020-07-30 08:32:40.791 INFO e9aba3435844 --- [pool-5-thread-1] o.a.k.c.c.ConsumerConfig : ConsumerConfig values: | |
| allow.auto.create.topics = true | |
| auto.commit.interval.ms = 5000 | |
| auto.offset.reset = earliest | |
| bootstrap.servers = [kafka:9092, localhost:9094] | |
| check.crcs = true | |
| client.dns.lookup = default | |
| client.id = | |
| client.rack = | |
| connections.max.idle.ms = 540000 | |
| default.api.timeout.ms = 60000 | |
| enable.auto.commit = false | |
| exclude.internal.topics = true | |
| fetch.max.bytes = 52428800 | |
| fetch.max.wait.ms = 500 | |
| fetch.min.bytes = 1 | |
| group.id = null | |
| group.instance.id = null | |
| heartbeat.interval.ms = 3000 | |
| interceptor.classes = [] | |
| internal.leave.group.on.close = true | |
| isolation.level = read_uncommitted | |
| key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| max.partition.fetch.bytes = 1048576 | |
| max.poll.interval.ms = 300000 | |
| max.poll.records = 500 | |
| metadata.max.age.ms = 300000 | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] | |
| receive.buffer.bytes = 524288 | |
| reconnect.backoff.max.ms = 1000 | |
| reconnect.backoff.ms = 50 | |
| request.timeout.ms = 30000 | |
| retry.backoff.ms = 100 | |
| sasl.client.callback.handler.class = null | |
| sasl.jaas.config = null | |
| sasl.kerberos.kinit.cmd = /usr/bin/kinit | |
| sasl.kerberos.min.time.before.relogin = 60000 | |
| sasl.kerberos.service.name = null | |
| sasl.kerberos.ticket.renew.jitter = 0.05 | |
| sasl.kerberos.ticket.renew.window.factor = 0.8 | |
| sasl.login.callback.handler.class = null | |
| sasl.login.class = null | |
| sasl.login.refresh.buffer.seconds = 300 | |
| sasl.login.refresh.min.period.seconds = 60 | |
| sasl.login.refresh.window.factor = 0.8 | |
| sasl.login.refresh.window.jitter = 0.05 | |
| sasl.mechanism = GSSAPI | |
| security.protocol = PLAINTEXT | |
| send.buffer.bytes = 131072 | |
| session.timeout.ms = 10000 | |
| ssl.cipher.suites = null | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLS | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| 2020-07-30 08:32:40.795 INFO e9aba3435844 --- [pool-5-thread-1] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0 | |
| 2020-07-30 08:32:40.795 INFO e9aba3435844 --- [pool-5-thread-1] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a | |
| 2020-07-30 08:32:40.795 INFO e9aba3435844 --- [pool-5-thread-1] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596097960795 | |
| 2020-07-30 08:32:40.796 WARN e9aba3435844 --- [pool-5-thread-1] o.a.k.c.NetworkClient : [Consumer clientId=consumer-3, groupId=null] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available. | |
| 2020-07-30 08:32:40.900 WARN e9aba3435844 --- [pool-5-thread-1] o.a.k.c.NetworkClient : [Consumer clientId=consumer-3, groupId=null] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available. | |
| 2020-07-30 08:32:41.006 INFO e9aba3435844 --- [pool-5-thread-1] o.a.k.c.Metadata : [Consumer clientId=consumer-3, groupId=null] Cluster ID: -nXps87PTrae9wy6VeJA6g | |
| 2020-07-30 08:32:41.126 INFO e9aba3435844 --- [pool-5-thread-1] o.a.b.s.i.k.KafkaUnboundedSource : Partitions assigned to split 0 (total 1): feast-specs-0 | |
| 2020-07-30 08:32:41.132 AUDIT e9aba3435844 --- [pool-5-thread-1] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job submitted to runner DirectRunner with ext id kafka-2111741832-to-online-1596097959656., id=kafka-2111741832-to-online-1596097959656, resource=JOB, timestamp=Thu Jul 30 08:32:41 UTC 2020} | |
| 2020-07-30 08:32:41.198 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Sending new FeatureSet default/customer_transactions to Ingestion | |
| 2020-07-30 08:32:41.205 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values: | |
| allow.auto.create.topics = true | |
| auto.commit.interval.ms = 5000 | |
| auto.offset.reset = latest | |
| bootstrap.servers = [kafka:9092, localhost:9094] | |
| check.crcs = true | |
| client.dns.lookup = default | |
| client.id = | |
| client.rack = | |
| connections.max.idle.ms = 540000 | |
| default.api.timeout.ms = 60000 | |
| enable.auto.commit = false | |
| exclude.internal.topics = true | |
| fetch.max.bytes = 52428800 | |
| fetch.max.wait.ms = 500 | |
| fetch.min.bytes = 1 | |
| group.id = feast_import_job_kafka-2111741832-to-online | |
| group.instance.id = null | |
| heartbeat.interval.ms = 3000 | |
| interceptor.classes = [] | |
| internal.leave.group.on.close = true | |
| isolation.level = read_committed | |
| key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| max.partition.fetch.bytes = 1048576 | |
| max.poll.interval.ms = 300000 | |
| max.poll.records = 500 | |
| metadata.max.age.ms = 300000 | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] | |
| receive.buffer.bytes = 524288 | |
| reconnect.backoff.max.ms = 1000 | |
| reconnect.backoff.ms = 50 | |
| request.timeout.ms = 30000 | |
| retry.backoff.ms = 100 | |
| sasl.client.callback.handler.class = null | |
| sasl.jaas.config = null | |
| sasl.kerberos.kinit.cmd = /usr/bin/kinit | |
| sasl.kerberos.min.time.before.relogin = 60000 | |
| sasl.kerberos.service.name = null | |
| sasl.kerberos.ticket.renew.jitter = 0.05 | |
| sasl.kerberos.ticket.renew.window.factor = 0.8 | |
| sasl.login.callback.handler.class = null | |
| sasl.login.class = null | |
| sasl.login.refresh.buffer.seconds = 300 | |
| sasl.login.refresh.min.period.seconds = 60 | |
| sasl.login.refresh.window.factor = 0.8 | |
| sasl.login.refresh.window.jitter = 0.05 | |
| sasl.mechanism = GSSAPI | |
| security.protocol = PLAINTEXT | |
| send.buffer.bytes = 131072 | |
| session.timeout.ms = 10000 | |
| ssl.cipher.suites = null | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLS | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| 2020-07-30 08:32:41.205 INFO e9aba3435844 --- [pool-3-thread-1] o.a.k.c.p.ProducerConfig : ProducerConfig values: | |
| acks = 1 | |
| batch.size = 16384 | |
| bootstrap.servers = [kafka:9092, localhost:9094] | |
| buffer.memory = 33554432 | |
| client.dns.lookup = default | |
| client.id = | |
| compression.type = none | |
| connections.max.idle.ms = 540000 | |
| delivery.timeout.ms = 120000 | |
| enable.idempotence = false | |
| interceptor.classes = [] | |
| key.serializer = class org.apache.kafka.common.serialization.StringSerializer | |
| linger.ms = 0 | |
| max.block.ms = 60000 | |
| max.in.flight.requests.per.connection = 5 | |
| max.request.size = 1048576 | |
| metadata.max.age.ms = 300000 | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner | |
| receive.buffer.bytes = 32768 | |
| reconnect.backoff.max.ms = 1000 | |
| reconnect.backoff.ms = 50 | |
| request.timeout.ms = 30000 | |
| retries = 2147483647 | |
| retry.backoff.ms = 100 | |
| sasl.client.callback.handler.class = null | |
| sasl.jaas.config = null | |
| sasl.kerberos.kinit.cmd = /usr/bin/kinit | |
| sasl.kerberos.min.time.before.relogin = 60000 | |
| sasl.kerberos.service.name = null | |
| sasl.kerberos.ticket.renew.jitter = 0.05 | |
| sasl.kerberos.ticket.renew.window.factor = 0.8 | |
| sasl.login.callback.handler.class = null | |
| sasl.login.class = null | |
| sasl.login.refresh.buffer.seconds = 300 | |
| sasl.login.refresh.min.period.seconds = 60 | |
| sasl.login.refresh.window.factor = 0.8 | |
| sasl.login.refresh.window.jitter = 0.05 | |
| sasl.mechanism = GSSAPI | |
| security.protocol = PLAINTEXT | |
| send.buffer.bytes = 131072 | |
| ssl.cipher.suites = null | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLS | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| transaction.timeout.ms = 60000 | |
| transactional.id = null | |
| value.serializer = class feast.core.util.KafkaSerialization$ProtoSerializer | |
| 2020-07-30 08:32:41.205 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values: | |
| allow.auto.create.topics = true | |
| auto.commit.interval.ms = 5000 | |
| auto.offset.reset = earliest | |
| bootstrap.servers = [kafka:9092, localhost:9094] | |
| check.crcs = true | |
| client.dns.lookup = default | |
| client.id = | |
| client.rack = | |
| connections.max.idle.ms = 540000 | |
| default.api.timeout.ms = 60000 | |
| enable.auto.commit = false | |
| exclude.internal.topics = true | |
| fetch.max.bytes = 52428800 | |
| fetch.max.wait.ms = 500 | |
| fetch.min.bytes = 1 | |
| group.id = null | |
| group.instance.id = null | |
| heartbeat.interval.ms = 3000 | |
| interceptor.classes = [] | |
| internal.leave.group.on.close = true | |
| isolation.level = read_uncommitted | |
| key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| max.partition.fetch.bytes = 1048576 | |
| max.poll.interval.ms = 300000 | |
| max.poll.records = 500 | |
| metadata.max.age.ms = 300000 | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] | |
| receive.buffer.bytes = 524288 | |
| reconnect.backoff.max.ms = 1000 | |
| reconnect.backoff.ms = 50 | |
| request.timeout.ms = 30000 | |
| retry.backoff.ms = 100 | |
| sasl.client.callback.handler.class = null | |
| sasl.jaas.config = null | |
| sasl.kerberos.kinit.cmd = /usr/bin/kinit | |
| sasl.kerberos.min.time.before.relogin = 60000 | |
| sasl.kerberos.service.name = null | |
| sasl.kerberos.ticket.renew.jitter = 0.05 | |
| sasl.kerberos.ticket.renew.window.factor = 0.8 | |
| sasl.login.callback.handler.class = null | |
| sasl.login.class = null | |
| sasl.login.refresh.buffer.seconds = 300 | |
| sasl.login.refresh.min.period.seconds = 60 | |
| sasl.login.refresh.window.factor = 0.8 | |
| sasl.login.refresh.window.jitter = 0.05 | |
| sasl.mechanism = GSSAPI | |
| security.protocol = PLAINTEXT | |
| send.buffer.bytes = 131072 | |
| session.timeout.ms = 10000 | |
| ssl.cipher.suites = null | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLS | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| 2020-07-30 08:32:41.211 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0 | |
| 2020-07-30 08:32:41.211 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a | |
| 2020-07-30 08:32:41.211 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596097961211 | |
| 2020-07-30 08:32:41.212 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0 | |
| 2020-07-30 08:32:41.212 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a | |
| 2020-07-30 08:32:41.212 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596097961212 | |
| 2020-07-30 08:32:41.231 INFO e9aba3435844 --- [pool-3-thread-1] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0 | |
| 2020-07-30 08:32:41.232 INFO e9aba3435844 --- [pool-3-thread-1] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a | |
| 2020-07-30 08:32:41.232 INFO e9aba3435844 --- [pool-3-thread-1] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596097961231 | |
| 2020-07-30 08:32:41.240 INFO e9aba3435844 --- [ad | producer-1] o.a.k.c.Metadata : [Producer clientId=producer-1] Cluster ID: -nXps87PTrae9wy6VeJA6g | |
| 2020-07-30 08:32:41.282 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-5, groupId=null] Subscribed to partition(s): feast-specs-0 | |
| 2020-07-30 08:32:41.282 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-4, groupId=feast_import_job_kafka-2111741832-to-online] Subscribed to partition(s): feast-features-0 | |
| 2020-07-30 08:32:41.288 INFO e9aba3435844 --- [ool-10-thread-1] o.a.k.c.Metadata : [Consumer clientId=consumer-5, groupId=null] Cluster ID: -nXps87PTrae9wy6VeJA6g | |
| 2020-07-30 08:32:41.288 WARN e9aba3435844 --- [ool-11-thread-1] o.a.k.c.NetworkClient : [Consumer clientId=consumer-4, groupId=feast_import_job_kafka-2111741832-to-online] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available. | |
| 2020-07-30 08:32:41.291 INFO e9aba3435844 --- [ool-11-thread-1] o.a.k.c.Metadata : [Consumer clientId=consumer-4, groupId=feast_import_job_kafka-2111741832-to-online] Cluster ID: -nXps87PTrae9wy6VeJA6g | |
| 2020-07-30 08:32:41.294 INFO e9aba3435844 --- [ool-10-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-5, groupId=null] Resetting offset for partition feast-specs-0 to offset 0. | |
| 2020-07-30 08:32:41.296 INFO e9aba3435844 --- [ool-11-thread-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-4, groupId=feast_import_job_kafka-2111741832-to-online] Discovered group coordinator kafka:9092 (id: 2147482646 rack: null) | |
| 2020-07-30 08:32:41.296 INFO e9aba3435844 --- [t-runner-worker] o.a.b.s.i.k.KafkaUnboundedSource : Reader-0: reading from feast-specs-0 starting at offset 0 | |
| 2020-07-30 08:32:41.298 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values: | |
| allow.auto.create.topics = true | |
| auto.commit.interval.ms = 5000 | |
| auto.offset.reset = earliest | |
| bootstrap.servers = [kafka:9092, localhost:9094] | |
| check.crcs = true | |
| client.dns.lookup = default | |
| client.id = | |
| client.rack = | |
| connections.max.idle.ms = 540000 | |
| default.api.timeout.ms = 60000 | |
| enable.auto.commit = false | |
| exclude.internal.topics = true | |
| fetch.max.bytes = 52428800 | |
| fetch.max.wait.ms = 500 | |
| fetch.min.bytes = 1 | |
| group.id = Reader-0_offset_consumer_496446629_none | |
| group.instance.id = null | |
| heartbeat.interval.ms = 3000 | |
| interceptor.classes = [] | |
| internal.leave.group.on.close = true | |
| isolation.level = read_uncommitted | |
| key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| max.partition.fetch.bytes = 1048576 | |
| max.poll.interval.ms = 300000 | |
| max.poll.records = 500 | |
| metadata.max.age.ms = 300000 | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] | |
| receive.buffer.bytes = 524288 | |
| reconnect.backoff.max.ms = 1000 | |
| reconnect.backoff.ms = 50 | |
| request.timeout.ms = 30000 | |
| retry.backoff.ms = 100 | |
| sasl.client.callback.handler.class = null | |
| sasl.jaas.config = null | |
| sasl.kerberos.kinit.cmd = /usr/bin/kinit | |
| sasl.kerberos.min.time.before.relogin = 60000 | |
| sasl.kerberos.service.name = null | |
| sasl.kerberos.ticket.renew.jitter = 0.05 | |
| sasl.kerberos.ticket.renew.window.factor = 0.8 | |
| sasl.login.callback.handler.class = null | |
| sasl.login.class = null | |
| sasl.login.refresh.buffer.seconds = 300 | |
| sasl.login.refresh.min.period.seconds = 60 | |
| sasl.login.refresh.window.factor = 0.8 | |
| sasl.login.refresh.window.jitter = 0.05 | |
| sasl.mechanism = GSSAPI | |
| security.protocol = PLAINTEXT | |
| send.buffer.bytes = 131072 | |
| session.timeout.ms = 10000 | |
| ssl.cipher.suites = null | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLS | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| 2020-07-30 08:32:41.301 INFO e9aba3435844 --- [ool-11-thread-1] o.a.k.c.c.i.ConsumerCoordinator : [Consumer clientId=consumer-4, groupId=feast_import_job_kafka-2111741832-to-online] Found no committed offset for partition feast-features-0 | |
| 2020-07-30 08:32:41.302 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0 | |
| 2020-07-30 08:32:41.302 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a | |
| 2020-07-30 08:32:41.302 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596097961301 | |
| 2020-07-30 08:32:41.304 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Subscribed to partition(s): feast-specs-0 | |
| 2020-07-30 08:32:41.305 INFO e9aba3435844 --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-4, groupId=feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0. | |
| 2020-07-30 08:32:41.305 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:41.305 INFO e9aba3435844 --- [t-runner-worker] o.a.b.s.i.k.KafkaUnboundedSource : Reader-0: reading from feast-features-0 starting at offset 0 | |
| 2020-07-30 08:32:41.306 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values: | |
| allow.auto.create.topics = true | |
| auto.commit.interval.ms = 5000 | |
| auto.offset.reset = latest | |
| bootstrap.servers = [kafka:9092, localhost:9094] | |
| check.crcs = true | |
| client.dns.lookup = default | |
| client.id = | |
| client.rack = | |
| connections.max.idle.ms = 540000 | |
| default.api.timeout.ms = 60000 | |
| enable.auto.commit = false | |
| exclude.internal.topics = true | |
| fetch.max.bytes = 52428800 | |
| fetch.max.wait.ms = 500 | |
| fetch.min.bytes = 1 | |
| group.id = Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online | |
| group.instance.id = null | |
| heartbeat.interval.ms = 3000 | |
| interceptor.classes = [] | |
| internal.leave.group.on.close = true | |
| isolation.level = read_uncommitted | |
| key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| max.partition.fetch.bytes = 1048576 | |
| max.poll.interval.ms = 300000 | |
| max.poll.records = 500 | |
| metadata.max.age.ms = 300000 | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] | |
| receive.buffer.bytes = 524288 | |
| reconnect.backoff.max.ms = 1000 | |
| reconnect.backoff.ms = 50 | |
| request.timeout.ms = 30000 | |
| retry.backoff.ms = 100 | |
| sasl.client.callback.handler.class = null | |
| sasl.jaas.config = null | |
| sasl.kerberos.kinit.cmd = /usr/bin/kinit | |
| sasl.kerberos.min.time.before.relogin = 60000 | |
| sasl.kerberos.service.name = null | |
| sasl.kerberos.ticket.renew.jitter = 0.05 | |
| sasl.kerberos.ticket.renew.window.factor = 0.8 | |
| sasl.login.callback.handler.class = null | |
| sasl.login.class = null | |
| sasl.login.refresh.buffer.seconds = 300 | |
| sasl.login.refresh.min.period.seconds = 60 | |
| sasl.login.refresh.window.factor = 0.8 | |
| sasl.login.refresh.window.jitter = 0.05 | |
| sasl.mechanism = GSSAPI | |
| security.protocol = PLAINTEXT | |
| send.buffer.bytes = 131072 | |
| session.timeout.ms = 10000 | |
| ssl.cipher.suites = null | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLS | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer | |
| 2020-07-30 08:32:41.311 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0 | |
| 2020-07-30 08:32:41.311 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.Metadata : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Cluster ID: -nXps87PTrae9wy6VeJA6g | |
| 2020-07-30 08:32:41.311 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a | |
| 2020-07-30 08:32:41.311 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596097961311 | |
| 2020-07-30 08:32:41.312 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Subscribed to partition(s): feast-features-0 | |
| 2020-07-30 08:32:41.313 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:41.314 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:41.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:41.316 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.Metadata : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Cluster ID: -nXps87PTrae9wy6VeJA6g | |
| 2020-07-30 08:32:41.329 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:41.332 INFO e9aba3435844 --- [t-runner-worker] o.a.b.s.i.k.KafkaUnboundedSource : Reader-0: first record offset 0 | |
| 2020-07-30 08:32:41.333 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0. | |
| 2020-07-30 08:32:41.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:41.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0. | |
| 2020-07-30 08:32:41.912 WARN e9aba3435844 --- [t-runner-worker] o.a.b.s.u.MutationDetectors : Coder of type class org.apache.beam.sdk.io.kafka.ProducerRecordCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element ProducerRecord(topic=feast-specs-ack, partition=null, headers=RecordHeaders(headers = [], isReadOnly = false), key=default/customer_transactions, value=[B@63d3ec5c, timestamp=null) | |
| 2020-07-30 08:32:41.923 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.p.ProducerConfig : ProducerConfig values: | |
| acks = 1 | |
| batch.size = 16384 | |
| bootstrap.servers = [kafka:9092, localhost:9094] | |
| buffer.memory = 33554432 | |
| client.dns.lookup = default | |
| client.id = | |
| compression.type = none | |
| connections.max.idle.ms = 540000 | |
| delivery.timeout.ms = 120000 | |
| enable.idempotence = false | |
| interceptor.classes = [] | |
| key.serializer = class org.apache.kafka.common.serialization.StringSerializer | |
| linger.ms = 0 | |
| max.block.ms = 60000 | |
| max.in.flight.requests.per.connection = 5 | |
| max.request.size = 1048576 | |
| metadata.max.age.ms = 300000 | |
| metric.reporters = [] | |
| metrics.num.samples = 2 | |
| metrics.recording.level = INFO | |
| metrics.sample.window.ms = 30000 | |
| partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner | |
| receive.buffer.bytes = 32768 | |
| reconnect.backoff.max.ms = 1000 | |
| reconnect.backoff.ms = 50 | |
| request.timeout.ms = 30000 | |
| retries = 3 | |
| retry.backoff.ms = 100 | |
| sasl.client.callback.handler.class = null | |
| sasl.jaas.config = null | |
| sasl.kerberos.kinit.cmd = /usr/bin/kinit | |
| sasl.kerberos.min.time.before.relogin = 60000 | |
| sasl.kerberos.service.name = null | |
| sasl.kerberos.ticket.renew.jitter = 0.05 | |
| sasl.kerberos.ticket.renew.window.factor = 0.8 | |
| sasl.login.callback.handler.class = null | |
| sasl.login.class = null | |
| sasl.login.refresh.buffer.seconds = 300 | |
| sasl.login.refresh.min.period.seconds = 60 | |
| sasl.login.refresh.window.factor = 0.8 | |
| sasl.login.refresh.window.jitter = 0.05 | |
| sasl.mechanism = GSSAPI | |
| security.protocol = PLAINTEXT | |
| send.buffer.bytes = 131072 | |
| ssl.cipher.suites = null | |
| ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] | |
| ssl.endpoint.identification.algorithm = https | |
| ssl.key.password = null | |
| ssl.keymanager.algorithm = SunX509 | |
| ssl.keystore.location = null | |
| ssl.keystore.password = null | |
| ssl.keystore.type = JKS | |
| ssl.protocol = TLS | |
| ssl.provider = null | |
| ssl.secure.random.implementation = null | |
| ssl.trustmanager.algorithm = PKIX | |
| ssl.truststore.location = null | |
| ssl.truststore.password = null | |
| ssl.truststore.type = JKS | |
| transaction.timeout.ms = 60000 | |
| transactional.id = null | |
| value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer | |
| 2020-07-30 08:32:41.926 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0 | |
| 2020-07-30 08:32:41.926 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a | |
| 2020-07-30 08:32:41.926 INFO e9aba3435844 --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596097961926 | |
| 2020-07-30 08:32:41.929 WARN e9aba3435844 --- [ad | producer-2] o.a.k.c.NetworkClient : [Producer clientId=producer-2] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available. | |
| 2020-07-30 08:32:41.932 INFO e9aba3435844 --- [ad | producer-2] o.a.k.c.Metadata : [Producer clientId=producer-2] Cluster ID: -nXps87PTrae9wy6VeJA6g | |
| 2020-07-30 08:32:41.933 WARN e9aba3435844 --- [t-runner-worker] o.a.b.s.u.MutationDetectors : Coder of type class org.apache.beam.sdk.io.kafka.ProducerRecordCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element ProducerRecord(topic=feast-specs-ack, partition=null, headers=RecordHeaders(headers = [], isReadOnly = false), key=default/customer_transactions, value=[B@54129c46, timestamp=null) | |
| 2020-07-30 08:32:41.939 WARN e9aba3435844 --- [t-runner-worker] o.a.b.s.u.MutationDetectors : Coder of type class org.apache.beam.sdk.io.kafka.ProducerRecordCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element ProducerRecord(topic=feast-specs-ack, partition=null, headers=RecordHeaders(headers = [], isReadOnly = false), key=default/customer_transactions, value=[B@54129c46, timestamp=null) | |
| 2020-07-30 08:32:41.950 INFO e9aba3435844 --- [ntainer#0-0-C-1] f.c.s.JobCoordinatorService : Updating featureSet default/customer_transactions delivery statuses. | |
| 2020-07-30 08:32:41.957 INFO e9aba3435844 --- [ntainer#0-0-C-1] f.c.s.JobCoordinatorService : FeatureSet default/customer_transactions update is completely delivered | |
| 2020-07-30 08:32:42.316 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:42.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:42.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:42.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0. | |
| 2020-07-30 08:32:43.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:43.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:43.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:43.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0. | |
| 2020-07-30 08:32:43.697 INFO e9aba3435844 --- [t-runner-worker] o.a.b.s.i.k.KafkaUnboundedSource : Reader-0: first record offset 0 | |
| 2020-07-30 08:32:44.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:44.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:44.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:44.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:45.316 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:45.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:45.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:45.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:46.316 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:46.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:46.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:46.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:47.316 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:47.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:47.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:47.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:48.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:48.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:48.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:48.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:49.316 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:49.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:49.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:49.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:50.316 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:50.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:50.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:50.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:51.316 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:51.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:51.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:51.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:52.316 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:52.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:52.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:52.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:53.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:53.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:53.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:53.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:54.316 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:54.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:54.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:54.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:55.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:55.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:55.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:55.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:56.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:56.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:56.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:56.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:57.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:57.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:57.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:57.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:58.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:58.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:58.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:58.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:32:59.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:32:59.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:32:59.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:32:59.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:00.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:00.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:00.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:00.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:01.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:01.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:01.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:01.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:02.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:02.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:02.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:02.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:03.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:03.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:03.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:03.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:04.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:04.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:04.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:04.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:05.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:05.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:05.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:05.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:06.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:06.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:06.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:06.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:07.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:07.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:07.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:07.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:08.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:08.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:08.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:08.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:09.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:09.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:09.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:09.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:10.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:10.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:10.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:10.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:11.147 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:33:11.158 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs... | |
| 2020-07-30 08:33:11.159 AUDIT e9aba3435844 --- [ool-15-thread-2] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-historical-1596097991156, resource=JOB, timestamp=Thu Jul 30 08:33:11 UTC 2020} | |
| 2020-07-30 08:33:11.163 INFO e9aba3435844 --- [ool-15-thread-2] f.i.ImportJob : Starting import job with settings: | |
| Current Settings: | |
| appName: DirectRunnerJobManager | |
| blockOnRun: false | |
| defaultFeastProject: default | |
| enforceEncodability: true | |
| enforceImmutability: true | |
| gcsPerformanceMetrics: false | |
| jobName: kafka-2111741832-to-historical-1596097991156 | |
| optionsId: 8 | |
| project: | |
| runner: class org.apache.beam.runners.direct.DirectRunner | |
| sourceJson: { | |
| "type": "KAFKA", | |
| "kafkaSourceConfig": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-features" | |
| } | |
| } | |
| specsStreamingUpdateConfigJson: { | |
| "source": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs" | |
| }, | |
| "ack": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs-ack" | |
| } | |
| } | |
| stableUniqueNames: WARNING | |
| storesJson: [{ | |
| "name": "historical", | |
| "type": "BIGQUERY", | |
| "subscriptions": [{ | |
| "name": "*", | |
| "project": "*" | |
| }], | |
| "bigqueryConfig": { | |
| "projectId": "project-feast-test", | |
| "datasetId": "test", | |
| "stagingLocation": "gs://feast-storage-bucket/test", | |
| "initialRetryDelaySeconds": 1, | |
| "totalTimeoutSeconds": 21600 | |
| } | |
| }] | |
| 2020-07-30 08:33:11.180 ERROR e9aba3435844 --- [ool-15-thread-2] f.c.j.d.DirectRunnerJobManager : Error submitting job | |
| java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.<init>(FixedWindows.java:65) | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.of(FixedWindows.java:50) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:135) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:49) | |
| at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:539) | |
| at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490) | |
| at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:368) | |
| at feast.ingestion.ImportJob.runPipeline(ImportJob.java:167) | |
| at feast.core.job.direct.DirectRunnerJobManager.runPipeline(DirectRunnerJobManager.java:164) | |
| at feast.core.job.direct.DirectRunnerJobManager.startJob(DirectRunnerJobManager.java:83) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:48) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:29) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) | |
| at java.base/java.lang.Thread.run(Unknown Source) | |
| 2020-07-30 08:33:11.180 ERROR e9aba3435844 --- [ool-15-thread-2] f.c.j.CreateJobTask : Error running ingestion job: java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| 2020-07-30 08:33:11.181 AUDIT e9aba3435844 --- [ool-15-thread-2] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job failed to be submitted to runner DirectRunner. Job status changed to ERROR., id=kafka-2111741832-to-historical-1596097991156, resource=JOB, timestamp=Thu Jul 30 08:33:11 UTC 2020} | |
| 2020-07-30 08:33:11.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:11.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:11.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:11.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:12.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:12.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:12.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:12.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:13.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:13.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:13.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:13.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:14.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:14.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:14.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:14.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:15.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:15.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:15.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:15.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:16.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:16.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:16.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:16.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:17.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:17.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:17.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:17.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:18.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:18.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:18.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:18.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:19.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:19.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:19.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:19.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:20.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:20.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:20.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:20.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:21.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:21.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:21.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:21.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:22.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:22.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:22.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:22.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:23.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:23.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:23.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:23.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:24.317 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:24.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:24.334 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:24.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:25.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:25.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:25.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:25.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:26.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:26.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:26.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:26.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:27.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:27.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:27.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:27.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:28.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:28.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:28.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:28.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:29.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:29.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:29.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:29.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:30.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:30.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:30.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:30.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:31.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:31.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:31.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:31.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:32.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:32.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:32.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:32.341 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:33.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:33.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:33.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:33.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:34.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:34.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:34.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:34.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:35.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:35.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:35.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:35.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:36.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:36.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:36.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:36.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:37.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:37.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:37.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:37.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:38.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:38.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:38.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:38.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:39.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:39.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:39.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:39.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:40.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:40.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:40.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:40.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:41.191 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:33:41.204 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs... | |
| 2020-07-30 08:33:41.205 AUDIT e9aba3435844 --- [ool-16-thread-2] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-historical-1596098021202, resource=JOB, timestamp=Thu Jul 30 08:33:41 UTC 2020} | |
| 2020-07-30 08:33:41.209 INFO e9aba3435844 --- [ool-16-thread-2] f.i.ImportJob : Starting import job with settings: | |
| Current Settings: | |
| appName: DirectRunnerJobManager | |
| blockOnRun: false | |
| defaultFeastProject: default | |
| enforceEncodability: true | |
| enforceImmutability: true | |
| gcsPerformanceMetrics: false | |
| jobName: kafka-2111741832-to-historical-1596098021202 | |
| optionsId: 9 | |
| project: | |
| runner: class org.apache.beam.runners.direct.DirectRunner | |
| sourceJson: { | |
| "type": "KAFKA", | |
| "kafkaSourceConfig": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-features" | |
| } | |
| } | |
| specsStreamingUpdateConfigJson: { | |
| "source": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs" | |
| }, | |
| "ack": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs-ack" | |
| } | |
| } | |
| stableUniqueNames: WARNING | |
| storesJson: [{ | |
| "name": "historical", | |
| "type": "BIGQUERY", | |
| "subscriptions": [{ | |
| "name": "*", | |
| "project": "*" | |
| }], | |
| "bigqueryConfig": { | |
| "projectId": "project-feast-test", | |
| "datasetId": "test", | |
| "stagingLocation": "gs://feast-storage-bucket/test", | |
| "initialRetryDelaySeconds": 1, | |
| "totalTimeoutSeconds": 21600 | |
| } | |
| }] | |
| 2020-07-30 08:33:41.226 ERROR e9aba3435844 --- [ool-16-thread-2] f.c.j.d.DirectRunnerJobManager : Error submitting job | |
| java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.<init>(FixedWindows.java:65) | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.of(FixedWindows.java:50) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:135) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:49) | |
| at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:539) | |
| at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490) | |
| at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:368) | |
| at feast.ingestion.ImportJob.runPipeline(ImportJob.java:167) | |
| at feast.core.job.direct.DirectRunnerJobManager.runPipeline(DirectRunnerJobManager.java:164) | |
| at feast.core.job.direct.DirectRunnerJobManager.startJob(DirectRunnerJobManager.java:83) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:48) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:29) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) | |
| at java.base/java.lang.Thread.run(Unknown Source) | |
| 2020-07-30 08:33:41.226 ERROR e9aba3435844 --- [ool-16-thread-2] f.c.j.CreateJobTask : Error running ingestion job: java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| 2020-07-30 08:33:41.226 AUDIT e9aba3435844 --- [ool-16-thread-2] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job failed to be submitted to runner DirectRunner. Job status changed to ERROR., id=kafka-2111741832-to-historical-1596098021202, resource=JOB, timestamp=Thu Jul 30 08:33:41 UTC 2020} | |
| 2020-07-30 08:33:41.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:41.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:41.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:41.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:42.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:42.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:42.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:42.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:43.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:43.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:43.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:43.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:44.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:44.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:44.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:44.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:45.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:45.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:45.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:45.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:46.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:46.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:46.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:46.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:47.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:47.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:47.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:47.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:48.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:48.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:48.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:48.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:49.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:49.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:49.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:49.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:50.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:50.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:50.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:50.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:51.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:51.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:51.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:51.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:52.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:52.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:52.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:52.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:53.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:53.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:53.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:53.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:54.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:54.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:54.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:54.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:55.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:55.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:55.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:55.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:56.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:56.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:56.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:56.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:57.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:57.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:57.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:57.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:58.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:58.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:58.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:58.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:33:59.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:33:59.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:33:59.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:33:59.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:00.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:00.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:00.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:00.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:01.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:01.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:01.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:01.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:02.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:02.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:02.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:02.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:03.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:03.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:03.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:03.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:04.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:04.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:04.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:04.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:05.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:05.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:05.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:05.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:06.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:06.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:06.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:06.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:07.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:07.323 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:07.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:07.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:08.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:08.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:08.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:08.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:09.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:09.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:09.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:09.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:10.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:10.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:10.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:10.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:11.235 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:34:11.247 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs... | |
| 2020-07-30 08:34:11.248 AUDIT e9aba3435844 --- [ool-17-thread-2] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-historical-1596098051246, resource=JOB, timestamp=Thu Jul 30 08:34:11 UTC 2020} | |
| 2020-07-30 08:34:11.251 INFO e9aba3435844 --- [ool-17-thread-2] f.i.ImportJob : Starting import job with settings: | |
| Current Settings: | |
| appName: DirectRunnerJobManager | |
| blockOnRun: false | |
| defaultFeastProject: default | |
| enforceEncodability: true | |
| enforceImmutability: true | |
| gcsPerformanceMetrics: false | |
| jobName: kafka-2111741832-to-historical-1596098051246 | |
| optionsId: 10 | |
| project: | |
| runner: class org.apache.beam.runners.direct.DirectRunner | |
| sourceJson: { | |
| "type": "KAFKA", | |
| "kafkaSourceConfig": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-features" | |
| } | |
| } | |
| specsStreamingUpdateConfigJson: { | |
| "source": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs" | |
| }, | |
| "ack": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs-ack" | |
| } | |
| } | |
| stableUniqueNames: WARNING | |
| storesJson: [{ | |
| "name": "historical", | |
| "type": "BIGQUERY", | |
| "subscriptions": [{ | |
| "name": "*", | |
| "project": "*" | |
| }], | |
| "bigqueryConfig": { | |
| "projectId": "project-feast-test", | |
| "datasetId": "test", | |
| "stagingLocation": "gs://feast-storage-bucket/test", | |
| "initialRetryDelaySeconds": 1, | |
| "totalTimeoutSeconds": 21600 | |
| } | |
| }] | |
| 2020-07-30 08:34:11.267 ERROR e9aba3435844 --- [ool-17-thread-2] f.c.j.d.DirectRunnerJobManager : Error submitting job | |
| java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.<init>(FixedWindows.java:65) | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.of(FixedWindows.java:50) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:135) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:49) | |
| at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:539) | |
| at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490) | |
| at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:368) | |
| at feast.ingestion.ImportJob.runPipeline(ImportJob.java:167) | |
| at feast.core.job.direct.DirectRunnerJobManager.runPipeline(DirectRunnerJobManager.java:164) | |
| at feast.core.job.direct.DirectRunnerJobManager.startJob(DirectRunnerJobManager.java:83) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:48) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:29) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) | |
| at java.base/java.lang.Thread.run(Unknown Source) | |
| 2020-07-30 08:34:11.267 ERROR e9aba3435844 --- [ool-17-thread-2] f.c.j.CreateJobTask : Error running ingestion job: java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| 2020-07-30 08:34:11.267 AUDIT e9aba3435844 --- [ool-17-thread-2] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job failed to be submitted to runner DirectRunner. Job status changed to ERROR., id=kafka-2111741832-to-historical-1596098051246, resource=JOB, timestamp=Thu Jul 30 08:34:11 UTC 2020} | |
| 2020-07-30 08:34:11.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:11.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:11.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:11.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:12.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:12.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:12.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:12.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:13.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:13.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:13.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:13.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:14.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:14.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:14.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:14.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:15.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:15.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:15.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:15.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:16.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:16.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:16.335 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:16.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:17.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:17.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:17.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:17.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:18.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:18.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:18.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:18.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:19.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:19.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:19.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:19.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:20.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:20.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:20.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:20.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:21.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:21.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:21.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:21.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:22.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:22.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:22.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:22.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:23.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:23.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:23.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:23.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:24.318 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:24.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:24.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:24.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:25.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:25.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:25.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:25.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:26.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:26.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:26.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:26.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:27.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:27.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:27.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:27.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:28.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:28.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:28.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:28.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:29.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:29.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:29.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:29.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:30.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:30.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:30.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:30.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:31.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:31.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:31.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:31.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:32.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:32.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:32.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:32.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:33.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:33.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:33.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:33.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:34.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:34.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:34.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:34.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:35.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:35.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:35.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:35.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:36.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:36.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:36.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:36.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:37.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:37.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:37.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:37.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:38.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:38.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:38.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:38.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:39.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:39.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:39.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:39.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:40.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:40.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:40.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:40.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:41.277 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:34:41.288 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs... | |
| 2020-07-30 08:34:41.289 AUDIT e9aba3435844 --- [ool-18-thread-2] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-historical-1596098081287, resource=JOB, timestamp=Thu Jul 30 08:34:41 UTC 2020} | |
| 2020-07-30 08:34:41.293 INFO e9aba3435844 --- [ool-18-thread-2] f.i.ImportJob : Starting import job with settings: | |
| Current Settings: | |
| appName: DirectRunnerJobManager | |
| blockOnRun: false | |
| defaultFeastProject: default | |
| enforceEncodability: true | |
| enforceImmutability: true | |
| gcsPerformanceMetrics: false | |
| jobName: kafka-2111741832-to-historical-1596098081287 | |
| optionsId: 11 | |
| project: | |
| runner: class org.apache.beam.runners.direct.DirectRunner | |
| sourceJson: { | |
| "type": "KAFKA", | |
| "kafkaSourceConfig": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-features" | |
| } | |
| } | |
| specsStreamingUpdateConfigJson: { | |
| "source": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs" | |
| }, | |
| "ack": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs-ack" | |
| } | |
| } | |
| stableUniqueNames: WARNING | |
| storesJson: [{ | |
| "name": "historical", | |
| "type": "BIGQUERY", | |
| "subscriptions": [{ | |
| "name": "*", | |
| "project": "*" | |
| }], | |
| "bigqueryConfig": { | |
| "projectId": "project-feast-test", | |
| "datasetId": "test", | |
| "stagingLocation": "gs://feast-storage-bucket/test", | |
| "initialRetryDelaySeconds": 1, | |
| "totalTimeoutSeconds": 21600 | |
| } | |
| }] | |
| 2020-07-30 08:34:41.309 ERROR e9aba3435844 --- [ool-18-thread-2] f.c.j.d.DirectRunnerJobManager : Error submitting job | |
| java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.<init>(FixedWindows.java:65) | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.of(FixedWindows.java:50) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:135) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:49) | |
| at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:539) | |
| at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490) | |
| at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:368) | |
| at feast.ingestion.ImportJob.runPipeline(ImportJob.java:167) | |
| at feast.core.job.direct.DirectRunnerJobManager.runPipeline(DirectRunnerJobManager.java:164) | |
| at feast.core.job.direct.DirectRunnerJobManager.startJob(DirectRunnerJobManager.java:83) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:48) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:29) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) | |
| at java.base/java.lang.Thread.run(Unknown Source) | |
| 2020-07-30 08:34:41.309 ERROR e9aba3435844 --- [ool-18-thread-2] f.c.j.CreateJobTask : Error running ingestion job: java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| 2020-07-30 08:34:41.309 AUDIT e9aba3435844 --- [ool-18-thread-2] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job failed to be submitted to runner DirectRunner. Job status changed to ERROR., id=kafka-2111741832-to-historical-1596098081287, resource=JOB, timestamp=Thu Jul 30 08:34:41 UTC 2020} | |
| 2020-07-30 08:34:41.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:41.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:41.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:41.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:42.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:42.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:42.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:42.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:43.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:43.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:43.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:43.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:44.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:44.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:44.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:44.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:45.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:45.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:45.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:45.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:46.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:46.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:46.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:46.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:47.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:47.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:47.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:47.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:48.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:48.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:48.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:48.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:49.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:49.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:49.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:49.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:50.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:50.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:50.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:50.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:51.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:51.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:51.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:51.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:52.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:52.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:52.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:52.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:53.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:53.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:53.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:53.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:54.319 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:54.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:54.336 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:54.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:55.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:55.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:55.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:55.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:56.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:56.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:56.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:56.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:57.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:57.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:57.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:57.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:58.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:58.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:58.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:58.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:34:59.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:34:59.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:34:59.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:34:59.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:00.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:00.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:00.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:00.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:01.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:01.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:01.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:01.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:02.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:02.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:02.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:02.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:03.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:03.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:03.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:03.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:04.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:04.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:04.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:04.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:05.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:05.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:05.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:05.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:06.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:06.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:06.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:06.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:07.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:07.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:07.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:07.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:08.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:08.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:08.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:08.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:09.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:09.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:09.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:09.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:10.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:10.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:10.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:10.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:11.317 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:35:11.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:11.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:11.329 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs... | |
| 2020-07-30 08:35:11.330 AUDIT e9aba3435844 --- [ool-19-thread-2] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-historical-1596098111327, resource=JOB, timestamp=Thu Jul 30 08:35:11 UTC 2020} | |
| 2020-07-30 08:35:11.332 INFO e9aba3435844 --- [ool-19-thread-2] f.i.ImportJob : Starting import job with settings: | |
| Current Settings: | |
| appName: DirectRunnerJobManager | |
| blockOnRun: false | |
| defaultFeastProject: default | |
| enforceEncodability: true | |
| enforceImmutability: true | |
| gcsPerformanceMetrics: false | |
| jobName: kafka-2111741832-to-historical-1596098111327 | |
| optionsId: 12 | |
| project: | |
| runner: class org.apache.beam.runners.direct.DirectRunner | |
| sourceJson: { | |
| "type": "KAFKA", | |
| "kafkaSourceConfig": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-features" | |
| } | |
| } | |
| specsStreamingUpdateConfigJson: { | |
| "source": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs" | |
| }, | |
| "ack": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs-ack" | |
| } | |
| } | |
| stableUniqueNames: WARNING | |
| storesJson: [{ | |
| "name": "historical", | |
| "type": "BIGQUERY", | |
| "subscriptions": [{ | |
| "name": "*", | |
| "project": "*" | |
| }], | |
| "bigqueryConfig": { | |
| "projectId": "project-feast-test", | |
| "datasetId": "test", | |
| "stagingLocation": "gs://feast-storage-bucket/test", | |
| "initialRetryDelaySeconds": 1, | |
| "totalTimeoutSeconds": 21600 | |
| } | |
| }] | |
| 2020-07-30 08:35:11.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:11.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:11.347 ERROR e9aba3435844 --- [ool-19-thread-2] f.c.j.d.DirectRunnerJobManager : Error submitting job | |
| java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.<init>(FixedWindows.java:65) | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.of(FixedWindows.java:50) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:135) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:49) | |
| at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:539) | |
| at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490) | |
| at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:368) | |
| at feast.ingestion.ImportJob.runPipeline(ImportJob.java:167) | |
| at feast.core.job.direct.DirectRunnerJobManager.runPipeline(DirectRunnerJobManager.java:164) | |
| at feast.core.job.direct.DirectRunnerJobManager.startJob(DirectRunnerJobManager.java:83) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:48) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:29) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) | |
| at java.base/java.lang.Thread.run(Unknown Source) | |
| 2020-07-30 08:35:11.348 ERROR e9aba3435844 --- [ool-19-thread-2] f.c.j.CreateJobTask : Error running ingestion job: java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| 2020-07-30 08:35:11.348 AUDIT e9aba3435844 --- [ool-19-thread-2] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job failed to be submitted to runner DirectRunner. Job status changed to ERROR., id=kafka-2111741832-to-historical-1596098111327, resource=JOB, timestamp=Thu Jul 30 08:35:11 UTC 2020} | |
| 2020-07-30 08:35:12.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:12.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:12.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:12.340 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:13.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:13.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:13.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:13.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:14.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:14.326 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:14.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:14.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:15.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:15.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:15.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:15.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:16.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:16.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:16.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:16.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:17.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:17.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:17.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:17.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:18.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:18.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:18.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:18.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:19.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:19.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:19.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:19.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:20.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:20.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:20.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:20.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:21.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:21.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:21.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:21.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:22.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:22.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:22.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:22.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:23.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:23.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:23.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:23.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:24.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:24.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:24.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:24.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:25.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:25.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:25.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:25.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:26.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:26.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:26.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:26.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:27.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:27.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:27.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:27.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:28.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:28.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:28.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:28.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:29.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:29.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:29.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:29.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:30.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:30.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:30.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:30.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:31.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:31.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:31.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:31.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:32.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:32.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:32.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:32.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:33.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:33.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:33.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:33.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:34.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:34.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:34.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:34.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:35.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:35.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:35.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:35.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:36.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:36.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:36.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:36.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:37.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:37.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:37.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:37.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:38.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:38.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:38.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:38.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:39.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:39.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:39.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:39.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:40.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:40.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:40.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:40.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:41.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:41.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:41.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:41.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:41.356 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs... | |
| 2020-07-30 08:35:41.366 INFO e9aba3435844 --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs... | |
| 2020-07-30 08:35:41.367 AUDIT e9aba3435844 --- [ool-20-thread-2] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-historical-1596098141365, resource=JOB, timestamp=Thu Jul 30 08:35:41 UTC 2020} | |
| 2020-07-30 08:35:41.369 INFO e9aba3435844 --- [ool-20-thread-2] f.i.ImportJob : Starting import job with settings: | |
| Current Settings: | |
| appName: DirectRunnerJobManager | |
| blockOnRun: false | |
| defaultFeastProject: default | |
| enforceEncodability: true | |
| enforceImmutability: true | |
| gcsPerformanceMetrics: false | |
| jobName: kafka-2111741832-to-historical-1596098141365 | |
| optionsId: 13 | |
| project: | |
| runner: class org.apache.beam.runners.direct.DirectRunner | |
| sourceJson: { | |
| "type": "KAFKA", | |
| "kafkaSourceConfig": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-features" | |
| } | |
| } | |
| specsStreamingUpdateConfigJson: { | |
| "source": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs" | |
| }, | |
| "ack": { | |
| "bootstrapServers": "kafka:9092,localhost:9094", | |
| "topic": "feast-specs-ack" | |
| } | |
| } | |
| stableUniqueNames: WARNING | |
| storesJson: [{ | |
| "name": "historical", | |
| "type": "BIGQUERY", | |
| "subscriptions": [{ | |
| "name": "*", | |
| "project": "*" | |
| }], | |
| "bigqueryConfig": { | |
| "projectId": "project-feast-test", | |
| "datasetId": "test", | |
| "stagingLocation": "gs://feast-storage-bucket/test", | |
| "initialRetryDelaySeconds": 1, | |
| "totalTimeoutSeconds": 21600 | |
| } | |
| }] | |
| 2020-07-30 08:35:41.384 ERROR e9aba3435844 --- [ool-20-thread-2] f.c.j.d.DirectRunnerJobManager : Error submitting job | |
| java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.<init>(FixedWindows.java:65) | |
| at org.apache.beam.sdk.transforms.windowing.FixedWindows.of(FixedWindows.java:50) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:135) | |
| at feast.storage.connectors.bigquery.writer.BigQueryWrite.expand(BigQueryWrite.java:49) | |
| at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:539) | |
| at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490) | |
| at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:368) | |
| at feast.ingestion.ImportJob.runPipeline(ImportJob.java:167) | |
| at feast.core.job.direct.DirectRunnerJobManager.runPipeline(DirectRunnerJobManager.java:164) | |
| at feast.core.job.direct.DirectRunnerJobManager.startJob(DirectRunnerJobManager.java:83) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:48) | |
| at feast.core.job.CreateJobTask.call(CreateJobTask.java:29) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) | |
| at java.base/java.util.concurrent.FutureTask.run(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) | |
| at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) | |
| at java.base/java.lang.Thread.run(Unknown Source) | |
| 2020-07-30 08:35:41.384 ERROR e9aba3435844 --- [ool-20-thread-2] f.c.j.CreateJobTask : Error running ingestion job: java.lang.IllegalArgumentException: FixedWindows WindowingStrategies must have 0 <= offset < size | |
| 2020-07-30 08:35:41.384 AUDIT e9aba3435844 --- [ool-20-thread-2] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job failed to be submitted to runner DirectRunner. Job status changed to ERROR., id=kafka-2111741832-to-historical-1596098141365, resource=JOB, timestamp=Thu Jul 30 08:35:41 UTC 2020} | |
| 2020-07-30 08:35:42.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:42.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:42.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:42.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:43.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:43.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:43.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:43.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:44.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:44.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:44.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:44.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:45.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:45.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:45.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:45.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:46.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:46.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:46.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:46.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:47.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:47.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:47.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:47.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:48.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:48.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:48.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:48.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:49.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:49.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:49.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:49.340 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:50.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:50.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:50.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:50.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:51.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:51.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:51.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:51.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:52.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:52.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:52.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:52.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:53.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:53.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:53.337 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:53.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:54.320 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:54.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:54.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:54.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:55.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:55.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:55.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:55.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:56.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:56.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:56.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:56.340 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:57.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:57.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:57.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:57.339 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:58.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:58.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:58.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:58.340 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:35:59.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:35:59.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:35:59.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:35:59.340 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. | |
| 2020-07-30 08:36:00.321 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Seeking to LATEST offset of partition feast-specs-0 | |
| 2020-07-30 08:36:00.322 INFO e9aba3435844 --- [ool-13-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_496446629_none] Resetting offset for partition feast-specs-0 to offset 1. | |
| 2020-07-30 08:36:00.338 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0 | |
| 2020-07-30 08:36:00.340 INFO e9aba3435844 --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_417784895_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 50. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| feast: | |
| core-host: core | |
| active_store: online | |
| stores: | |
| - name: online | |
| type: REDIS | |
| config: | |
| host: redis | |
| port: 6379 | |
| subscriptions: | |
| - name: "*" | |
| project: "*" |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment