Skip to content

Instantly share code, notes, and snippets.

@nsivabalan

nsivabalan/s3 stack trace

Created June 24, 2021 19:44
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save nsivabalan/af2606945c813a057303d89eb09b277c to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save nsivabalan/af2606945c813a057303d89eb09b277c to your computer and use it in GitHub Desktop.
Download ZIP
Raw
s3 stack trace
21/06/24 19:38:17 DEBUG HttpConnection: HttpConnection@f0ca2d2::SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=4/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=START,0 of -1},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=0,c=false,c=false/false,a=IDLE,uri=null,age=0} parse HeapByteBuffer@4ff2cf3e[p=0,l=534,c=8192,r=534]={<<<POST /v1/hoodie/v...zip,deflate\r\n\r\n>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00} {}
21/06/24 19:38:17 DEBUG HttpParser: parseNext s=START HeapByteBuffer@4ff2cf3e[p=0,l=534,c=8192,r=534]={<<<POST /v1/hoodie/v...zip,deflate\r\n\r\n>>>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00...\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00}
21/06/24 19:38:17 DEBUG HttpParser: START --> SPACE1
21/06/24 19:38:17 DEBUG HttpParser: SPACE1 --> URI
21/06/24 19:38:17 DEBUG HttpParser: URI --> SPACE2
21/06/24 19:38:17 DEBUG HttpParser: SPACE2 --> REQUEST_VERSION
21/06/24 19:38:17 DEBUG HttpParser: REQUEST_VERSION --> HEADER
21/06/24 19:38:17 DEBUG HttpParser: HEADER:Content-Length: 0 --> IN_VALUE
21/06/24 19:38:17 DEBUG HttpParser: HEADER:Content-Length: 0 --> FIELD
21/06/24 19:38:17 DEBUG HttpParser: HEADER:Host --> VALUE
21/06/24 19:38:17 DEBUG HttpParser: HEADER:Host --> IN_VALUE
21/06/24 19:38:17 DEBUG HttpParser: HEADER:Host --> FIELD
21/06/24 19:38:17 DEBUG HttpParser: HEADER:Connection: keep-alive --> IN_VALUE
21/06/24 19:38:17 DEBUG HttpParser: HEADER:Connection: keep-alive --> FIELD
21/06/24 19:38:17 DEBUG HttpParser: HEADER:User-Agent --> VALUE
21/06/24 19:38:17 DEBUG HttpParser: HEADER:User-Agent --> IN_VALUE
21/06/24 19:38:17 DEBUG HttpParser: HEADER:User-Agent --> FIELD
21/06/24 19:38:17 DEBUG HttpParser: HEADER:Accept-Encoding --> IN_VALUE
21/06/24 19:38:17 DEBUG HttpParser: HEADER:Accept-Encoding --> FIELD
21/06/24 19:38:17 DEBUG HttpParser: HEADER --> END
21/06/24 19:38:17 DEBUG HttpChannel: REQUEST for //ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 on HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=IDLE,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=2}
POST //ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 HTTP/1.1
Content-Length: 0
Host: ip-172-31-35-161.us-east-2.compute.internal:45185
Connection: keep-alive
User-Agent: Apache-HttpClient/4.4.1 (Java/1.8.0_282)
Accept-Encoding: gzip,deflate
21/06/24 19:38:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=IDLE,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=4} onContentComplete
21/06/24 19:38:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=IDLE,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=4} onRequestComplete
21/06/24 19:38:17 DEBUG HttpInput: HttpInputOverHTTP@31675cca[c=0,q=0,[0]=null,s=STREAM] addContent EOF
21/06/24 19:38:17 DEBUG HttpConnection: HttpConnection@f0ca2d2::SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=25/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=IDLE,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=5} parsed true HttpParser{s=END,0 of 0}
21/06/24 19:38:17 DEBUG HttpConnection: releaseRequestBuffer HttpConnection@f0ca2d2::SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=25/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=IDLE,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=5}
21/06/24 19:38:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=IDLE,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=5} handle //ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/24 19:38:17 DEBUG HttpChannelState: handling HttpChannelState@6b877328{s=IDLE a=NOT_ASYNC i=true r=IDLE w=false}
21/06/24 19:38:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=8} action DISPATCH
21/06/24 19:38:17 INFO MarkerHandler: Start processing create marker requests
21/06/24 19:38:17 INFO MarkerHandler: TEST_LOG. 000 Iterating through existing requests, size=0
21/06/24 19:38:17 INFO MarkerHandler: TEST_LOG. 555. Completed processing all requests
21/06/24 19:38:17 INFO MarkerHandler: Flush to MARKERS file ..
21/06/24 19:38:17 INFO MarkerHandler: Resolve request futures ..
21/06/24 19:38:17 INFO MarkerHandler: Finish batch processing of create marker requests
21/06/24 19:38:17 INFO MarkerHandler: Request: create marker s3a://siva-test-bucket-june-16/hudi_testing/hudi_base_105/.hoodie/.temp/20210624193733 2020-02-01/48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE
21/06/24 19:38:17 INFO MarkerHandler: Request: futures list size : 1
21/06/24 19:38:17 DEBUG RequestHandler: TimeTakenMillis[Total=3, Refresh=0, handle=3, Check=0], Success=true, Query=markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-161.us-east-2.compute.internal:45185, synced=false
21/06/24 19:38:17 DEBUG HttpChannelState: startAsync HttpChannelState@6b877328{s=DISPATCHED a=NOT_ASYNC i=true r=IDLE w=false}
21/06/24 19:38:17 DEBUG HttpChannelState: unhandle HttpChannelState@6b877328{s=DISPATCHED a=STARTED i=true r=IDLE w=false}
21/06/24 19:38:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=75} action WAIT
21/06/24 19:38:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=75} handle exit, result WAIT
21/06/24 19:38:17 DEBUG HttpConnection: HttpConnection@f0ca2d2::SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=95/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=75} onFillable exit HttpChannelState@6b877328{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false} null
21/06/24 19:38:17 INFO MarkerHandler: Start processing create marker requests
21/06/24 19:38:17 INFO MarkerHandler: TEST_LOG. 000 Iterating through existing requests, size=1
21/06/24 19:38:17 INFO MarkerHandler: TEST_LOG. 111 --- markerDirPath=s3a://siva-test-bucket-june-16/hudi_testing/hudi_base_105/.hoodie/.temp/20210624193733 markerName=2020-02-01/48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE
21/06/24 19:38:17 INFO MarkerHandler: Get all markers from s3a://siva-test-bucket-june-16/hudi_testing/hudi_base_105/.hoodie/.temp/20210624193733
21/06/24 19:38:47 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=29908/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=29888} idle timeout check, elapsed: 29908 ms, remaining: 92 ms
21/06/24 19:38:47 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=29981} idle timeout check, elapsed: 30001 ms, remaining: -1 ms
21/06/24 19:38:47 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30002/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=29982} idle timeout expired
21/06/24 19:38:47 DEBUG FillInterest: onFail FillInterest@2bed967e{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30001/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:38:47 DEBUG WriteFlusher: ignored: WriteFlusher@1839697e{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30001/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:38:47 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30006/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=29986}
21/06/24 19:38:47 DEBUG HttpChannelState: onTimeout HttpChannelState@6b877328{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/24 19:38:47 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:38:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=30077} handle //ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/24 19:38:47 DEBUG HttpChannelState: handling HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:38:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=30078} action ERROR_DISPATCH
21/06/24 19:38:47 INFO MarkerHandler: Request: create marker s3a://siva-test-bucket-june-16/hudi_testing/hudi_base_105/.hoodie/.temp/20210624193733 2020-02-01/48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE
21/06/24 19:38:47 INFO MarkerHandler: Request: futures list size : 2
21/06/24 19:38:47 DEBUG RequestHandler: TimeTakenMillis[Total=1, Refresh=0, handle=1, Check=0], Success=true, Query=markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-161.us-east-2.compute.internal:45185, synced=false
21/06/24 19:38:47 DEBUG HttpChannelState: startAsync HttpChannelState@6b877328{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/24 19:38:47 DEBUG HttpChannelState: unhandle HttpChannelState@6b877328{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/24 19:38:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=30082} action WAIT
21/06/24 19:38:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=30082} handle exit, result WAIT
21/06/24 19:38:48 WARN Signaling: Cancelling all active jobs, this can take a while. Press Ctrl+C again to exit now.
org.apache.spark.SparkException: Job 3 cancelled as part of cancellation of all jobs
at org.apache.spark.scheduler.DAGScheduler.failJobAndIndependentStages(DAGScheduler.scala:2059)
at org.apache.spark.scheduler.DAGScheduler.handleJobCancellation(DAGScheduler.scala:1955)
at org.apache.spark.scheduler.DAGScheduler.$anonfun$doCancelAllJobs$2(DAGScheduler.scala:878)
at scala.runtime.java8.JFunction1$mcVI$sp.apply(JFunction1$mcVI$sp.java:23)
at scala.collection.mutable.HashSet.foreach(HashSet.scala:79)
at org.apache.spark.scheduler.DAGScheduler.doCancelAllJobs(DAGScheduler.scala:877)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:2211)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2188)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2177)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:49)
at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:775)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2099)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2120)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2139)
at org.apache.spark.rdd.RDD.$anonfun$take$1(RDD.scala:1423)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:388)
at org.apache.spark.rdd.RDD.take(RDD.scala:1396)
at org.apache.spark.rdd.RDD.$anonfun$isEmpty$1(RDD.scala:1531)
at scala.runtime.java8.JFunction0$mcZ$sp.apply(JFunction0$mcZ$sp.java:23)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:388)
at org.apache.spark.rdd.RDD.isEmpty(RDD.scala:1531)
at org.apache.hudi.HoodieSparkSqlWriter$.commitAndPerformPostOperations(HoodieSparkSqlWriter.scala:559)
at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:232)
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:162)
at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:46)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:90)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$execute$1(SparkPlan.scala:175)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:213)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:210)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:171)
at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:122)
at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:121)
at org.apache.spark.sql.DataFrameWriter.$anonfun$runCommand$1(DataFrameWriter.scala:963)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$5(SQLExecution.scala:100)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:160)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withNewExecutionId$1(SQLExecution.scala:87)
at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:764)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:64)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:963)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:415)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:399)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:288)
at $anonfun$res2$1(<console>:41)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at org.apache.spark.sql.SparkSession.time(SparkSession.scala:668)
... 57 elided
21/06/24 19:39:17 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30000/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=59987} idle timeout check, elapsed: 30000 ms, remaining: 0 ms
21/06/24 19:39:17 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30000/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=59987} idle timeout expired
21/06/24 19:39:17 DEBUG FillInterest: onFail FillInterest@2bed967e{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:39:17 DEBUG WriteFlusher: ignored: WriteFlusher@1839697e{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:39:17 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=59988}
21/06/24 19:39:17 DEBUG HttpChannelState: onTimeout HttpChannelState@6b877328{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/24 19:39:17 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:39:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=60083} handle //ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/24 19:39:17 DEBUG HttpChannelState: handling HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:39:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=60083} action ERROR_DISPATCH
21/06/24 19:39:17 INFO MarkerHandler: Request: create marker s3a://siva-test-bucket-june-16/hudi_testing/hudi_base_105/.hoodie/.temp/20210624193733 2020-02-01/48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE
21/06/24 19:39:17 INFO MarkerHandler: Request: futures list size : 3
21/06/24 19:39:17 DEBUG RequestHandler: TimeTakenMillis[Total=1, Refresh=0, handle=1, Check=0], Success=true, Query=markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-161.us-east-2.compute.internal:45185, synced=false
21/06/24 19:39:17 DEBUG HttpChannelState: startAsync HttpChannelState@6b877328{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/24 19:39:17 DEBUG HttpChannelState: unhandle HttpChannelState@6b877328{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/24 19:39:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=60084} action WAIT
21/06/24 19:39:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=60084} handle exit, result WAIT
21/06/24 19:39:47 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30000/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=89989} idle timeout check, elapsed: 30000 ms, remaining: 0 ms
21/06/24 19:39:47 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=89989} idle timeout expired
21/06/24 19:39:47 DEBUG FillInterest: onFail FillInterest@2bed967e{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:39:47 DEBUG WriteFlusher: ignored: WriteFlusher@1839697e{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:39:47 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30002/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=89990}
21/06/24 19:39:47 DEBUG HttpChannelState: onTimeout HttpChannelState@6b877328{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/24 19:39:47 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:39:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=90085} handle //ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/24 19:39:47 DEBUG HttpChannelState: handling HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:39:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=90085} action ERROR_DISPATCH
21/06/24 19:39:47 INFO MarkerHandler: Request: create marker s3a://siva-test-bucket-june-16/hudi_testing/hudi_base_105/.hoodie/.temp/20210624193733 2020-02-01/48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE
21/06/24 19:39:47 INFO MarkerHandler: Request: futures list size : 4
21/06/24 19:39:47 DEBUG RequestHandler: TimeTakenMillis[Total=0, Refresh=0, handle=0, Check=0], Success=true, Query=markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-161.us-east-2.compute.internal:45185, synced=false
21/06/24 19:39:47 DEBUG HttpChannelState: startAsync HttpChannelState@6b877328{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/24 19:39:47 DEBUG HttpChannelState: unhandle HttpChannelState@6b877328{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/24 19:39:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=90086} action WAIT
21/06/24 19:39:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=90086} handle exit, result WAIT
21/06/24 19:40:17 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=119991} idle timeout check, elapsed: 30000 ms, remaining: 0 ms
21/06/24 19:40:17 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=119991} idle timeout expired
21/06/24 19:40:17 DEBUG FillInterest: onFail FillInterest@2bed967e{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:40:17 DEBUG WriteFlusher: ignored: WriteFlusher@1839697e{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:40:17 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30002/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=119992}
21/06/24 19:40:17 DEBUG HttpChannelState: onTimeout HttpChannelState@6b877328{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/24 19:40:17 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:40:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=120086} handle //ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/24 19:40:17 DEBUG HttpChannelState: handling HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:40:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=120087} action ERROR_DISPATCH
21/06/24 19:40:17 INFO MarkerHandler: Request: create marker s3a://siva-test-bucket-june-16/hudi_testing/hudi_base_105/.hoodie/.temp/20210624193733 2020-02-01/48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE
21/06/24 19:40:17 INFO MarkerHandler: Request: futures list size : 5
21/06/24 19:40:17 DEBUG RequestHandler: TimeTakenMillis[Total=0, Refresh=0, handle=0, Check=0], Success=true, Query=markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-161.us-east-2.compute.internal:45185, synced=false
21/06/24 19:40:17 DEBUG HttpChannelState: startAsync HttpChannelState@6b877328{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/24 19:40:17 DEBUG HttpChannelState: unhandle HttpChannelState@6b877328{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/24 19:40:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=120087} action WAIT
21/06/24 19:40:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=120088} handle exit, result WAIT
21/06/24 19:40:47 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30000/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=149993} idle timeout check, elapsed: 30000 ms, remaining: 0 ms
21/06/24 19:40:47 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=149993} idle timeout expired
21/06/24 19:40:47 DEBUG FillInterest: onFail FillInterest@2bed967e{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:40:47 DEBUG WriteFlusher: ignored: WriteFlusher@1839697e{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:40:47 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30002/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=149994}
21/06/24 19:40:47 DEBUG HttpChannelState: onTimeout HttpChannelState@6b877328{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/24 19:40:47 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:40:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=150088} handle //ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/24 19:40:47 DEBUG HttpChannelState: handling HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:40:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=150088} action ERROR_DISPATCH
21/06/24 19:40:47 INFO MarkerHandler: Request: create marker s3a://siva-test-bucket-june-16/hudi_testing/hudi_base_105/.hoodie/.temp/20210624193733 2020-02-01/48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE
21/06/24 19:40:47 INFO MarkerHandler: Request: futures list size : 6
21/06/24 19:40:47 DEBUG RequestHandler: TimeTakenMillis[Total=0, Refresh=0, handle=0, Check=0], Success=true, Query=markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-161.us-east-2.compute.internal:45185, synced=false
21/06/24 19:40:47 DEBUG HttpChannelState: startAsync HttpChannelState@6b877328{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/24 19:40:47 DEBUG HttpChannelState: unhandle HttpChannelState@6b877328{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/24 19:40:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=150089} action WAIT
21/06/24 19:40:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=150089} handle exit, result WAIT
21/06/24 19:41:17 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30000/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=179994} idle timeout check, elapsed: 30000 ms, remaining: 0 ms
21/06/24 19:41:17 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=179995} idle timeout expired
21/06/24 19:41:17 DEBUG FillInterest: onFail FillInterest@2bed967e{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:41:17 DEBUG WriteFlusher: ignored: WriteFlusher@1839697e{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:41:17 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=179995}
21/06/24 19:41:17 DEBUG HttpChannelState: onTimeout HttpChannelState@6b877328{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/24 19:41:17 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:41:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=180090} handle //ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/24 19:41:17 DEBUG HttpChannelState: handling HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:41:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=180090} action ERROR_DISPATCH
21/06/24 19:41:17 INFO MarkerHandler: Request: create marker s3a://siva-test-bucket-june-16/hudi_testing/hudi_base_105/.hoodie/.temp/20210624193733 2020-02-01/48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE
21/06/24 19:41:17 INFO MarkerHandler: Request: futures list size : 7
21/06/24 19:41:17 DEBUG RequestHandler: TimeTakenMillis[Total=1, Refresh=0, handle=1, Check=0], Success=true, Query=markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-161.us-east-2.compute.internal:45185, synced=false
21/06/24 19:41:17 DEBUG HttpChannelState: startAsync HttpChannelState@6b877328{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/24 19:41:17 DEBUG HttpChannelState: unhandle HttpChannelState@6b877328{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/24 19:41:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=180091} action WAIT
21/06/24 19:41:17 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=180091} handle exit, result WAIT
21/06/24 19:41:47 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=209996} idle timeout check, elapsed: 30001 ms, remaining: -1 ms
21/06/24 19:41:47 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=209996} idle timeout expired
21/06/24 19:41:47 DEBUG FillInterest: onFail FillInterest@2bed967e{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30001/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:41:47 DEBUG WriteFlusher: ignored: WriteFlusher@1839697e{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30001/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:41:47 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30002/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=209997}
21/06/24 19:41:47 DEBUG HttpChannelState: onTimeout HttpChannelState@6b877328{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/24 19:41:47 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:41:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=210091} handle //ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/24 19:41:47 DEBUG HttpChannelState: handling HttpChannelState@6b877328{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/24 19:41:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=210092} action ERROR_DISPATCH
21/06/24 19:41:47 INFO MarkerHandler: Request: create marker s3a://siva-test-bucket-june-16/hudi_testing/hudi_base_105/.hoodie/.temp/20210624193733 2020-02-01/48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE
21/06/24 19:41:47 INFO MarkerHandler: Request: futures list size : 8
21/06/24 19:41:47 DEBUG RequestHandler: TimeTakenMillis[Total=0, Refresh=0, handle=0, Check=0], Success=true, Query=markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-161.us-east-2.compute.internal:45185, synced=false
21/06/24 19:41:47 DEBUG HttpChannelState: startAsync HttpChannelState@6b877328{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/24 19:41:47 DEBUG HttpChannelState: unhandle HttpChannelState@6b877328{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/24 19:41:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=210092} action WAIT
21/06/24 19:41:47 DEBUG HttpChannel: HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=210092} handle exit, result WAIT
21/06/24 19:42:17 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30000/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=239997} idle timeout check, elapsed: 30000 ms, remaining: 0 ms
21/06/24 19:42:17 DEBUG IdleTimeout: SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30002/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=239999} idle timeout expired
21/06/24 19:42:17 DEBUG FillInterest: onFail FillInterest@2bed967e{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:42:17 DEBUG WriteFlusher: ignored: WriteFlusher@1839697e{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/24 19:42:17 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@1c0d1758{/172.31.40.111:49150<->/172.31.35.161:45185,OPEN,fill=-,flush=-,to=30002/30000}{io=0/0,kio=0,kro=1}->HttpConnection@f0ca2d2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@58d1601e{s=START}]=>HttpChannelOverHttp@2a2e8dd8{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-161.us-east-2.compute.internal:45185/v1/hoodie/view/marker/create?markername=2020-02-01%2F48e0c11c-f26f-4367-9001-9d2311d8b0ec-0_0-7-20_20210624193733.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210624193733&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=239999}
21/06/24 19:42:17 DEBUG HttpChannelState: onTimeout HttpChannelState@6b877328{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment