Skip to content

Instantly share code, notes, and snippets.

@nsivabalan

nsivabalan/S3 stacktrace for marker based rollback

Created June 23, 2021 23:20
Show Gist options
  • Save nsivabalan/031d1604ca60c71b47dd1ad4267392c0 to your computer and use it in GitHub Desktop.
Save nsivabalan/031d1604ca60c71b47dd1ad4267392c0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
S3 stacktrace for marker based rollback
21/06/23 22:45:09 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@3b772bac{/172.31.35.212:46962<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@21fc48c2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@7dbf8533{s=START}]=>HttpChannelOverHttp@596f6a9a{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-59_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1470050}
21/06/23 22:45:09 DEBUG HttpChannelState: onTimeout HttpChannelState@96666b9{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@96666b9{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@596f6a9a{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-59_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1470137} handle //ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-59_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/23 22:45:09 DEBUG HttpChannelState: handling HttpChannelState@96666b9{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@596f6a9a{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-59_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1470137} action ERROR_DISPATCH
21/06/23 22:45:09 DEBUG RequestHandler: TimeTakenMillis[Total=0, Refresh=0, handle=0, Check=0], Success=true, Query=markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-59_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-80.us-east-2.compute.internal:37099, synced=false
21/06/23 22:45:09 DEBUG HttpChannelState: startAsync HttpChannelState@96666b9{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannelState: unhandle HttpChannelState@96666b9{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@596f6a9a{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-59_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1470138} action WAIT
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@596f6a9a{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-59_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1470138} handle exit, result WAIT
21/06/23 22:45:09 DEBUG IdleTimeout: SocketChannelEndPoint@13cd6268{/172.31.35.212:46996<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30000/30000}{io=0/0,kio=0,kro=1}->HttpConnection@5c37945a[p=HttpParser{s=END,0 of 0},g=HttpGenerator@24917396{s=START}]=>HttpChannelOverHttp@1d0a9e61{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-60_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1170044} idle timeout check, elapsed: 30000 ms, remaining: 0 ms
21/06/23 22:45:09 DEBUG IdleTimeout: SocketChannelEndPoint@13cd6268{/172.31.35.212:46996<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@5c37945a[p=HttpParser{s=END,0 of 0},g=HttpGenerator@24917396{s=START}]=>HttpChannelOverHttp@1d0a9e61{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-60_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1170045} idle timeout expired
21/06/23 22:45:09 DEBUG FillInterest: onFail FillInterest@6da108f3{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/23 22:45:09 DEBUG WriteFlusher: ignored: WriteFlusher@2bebc134{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/23 22:45:09 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@13cd6268{/172.31.35.212:46996<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@5c37945a[p=HttpParser{s=END,0 of 0},g=HttpGenerator@24917396{s=START}]=>HttpChannelOverHttp@1d0a9e61{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-60_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1170045}
21/06/23 22:45:09 DEBUG HttpChannelState: onTimeout HttpChannelState@19350918{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@19350918{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@1d0a9e61{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-60_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1170053} handle //ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-60_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/23 22:45:09 DEBUG HttpChannelState: handling HttpChannelState@19350918{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@1d0a9e61{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-60_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1170054} action ERROR_DISPATCH
21/06/23 22:45:09 DEBUG RequestHandler: TimeTakenMillis[Total=0, Refresh=0, handle=0, Check=0], Success=true, Query=markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-60_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-80.us-east-2.compute.internal:37099, synced=false
21/06/23 22:45:09 DEBUG HttpChannelState: startAsync HttpChannelState@19350918{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannelState: unhandle HttpChannelState@19350918{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@1d0a9e61{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-60_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1170054} action WAIT
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@1d0a9e61{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-60_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1170054} handle exit, result WAIT
21/06/23 22:45:09 DEBUG IdleTimeout: SocketChannelEndPoint@5cedb196{/172.31.35.212:47038<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30000/30000}{io=0/0,kio=0,kro=1}->HttpConnection@76b9d6c7[p=HttpParser{s=END,0 of 0},g=HttpGenerator@47e9b887{s=START}]=>HttpChannelOverHttp@3c186b15{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-61_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=870034} idle timeout check, elapsed: 30000 ms, remaining: 0 ms
21/06/23 22:45:09 DEBUG IdleTimeout: SocketChannelEndPoint@5cedb196{/172.31.35.212:47038<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@76b9d6c7[p=HttpParser{s=END,0 of 0},g=HttpGenerator@47e9b887{s=START}]=>HttpChannelOverHttp@3c186b15{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-61_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=870035} idle timeout expired
21/06/23 22:45:09 DEBUG FillInterest: onFail FillInterest@385633ac{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/23 22:45:09 DEBUG WriteFlusher: ignored: WriteFlusher@486b9516{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/23 22:45:09 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@5cedb196{/172.31.35.212:47038<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@76b9d6c7[p=HttpParser{s=END,0 of 0},g=HttpGenerator@47e9b887{s=START}]=>HttpChannelOverHttp@3c186b15{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-61_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=870035}
21/06/23 22:45:09 DEBUG HttpChannelState: onTimeout HttpChannelState@133aa2c3{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@133aa2c3{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@3c186b15{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-61_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=870038} handle //ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-61_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/23 22:45:09 DEBUG HttpChannelState: handling HttpChannelState@133aa2c3{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@3c186b15{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-61_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=870038} action ERROR_DISPATCH
21/06/23 22:45:09 DEBUG RequestHandler: TimeTakenMillis[Total=0, Refresh=0, handle=0, Check=0], Success=true, Query=markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-61_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-80.us-east-2.compute.internal:37099, synced=false
21/06/23 22:45:09 DEBUG HttpChannelState: startAsync HttpChannelState@133aa2c3{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannelState: unhandle HttpChannelState@133aa2c3{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@3c186b15{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-61_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=870039} action WAIT
21/06/23 22:45:09 DEBUG HttpChannel: HttpChannelOverHttp@3c186b15{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-61_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=870039} handle exit, result WAIT
21/06/23 22:45:10 DEBUG IdleTimeout: SocketChannelEndPoint@45e789ce{/172.31.35.212:47064<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30000/30000}{io=0/0,kio=0,kro=1}->HttpConnection@a1d7539[p=HttpParser{s=END,0 of 0},g=HttpGenerator@73cd344d{s=START}]=>HttpChannelOverHttp@4b207f02{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-62_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=570022} idle timeout check, elapsed: 30000 ms, remaining: 0 ms
21/06/23 22:45:10 DEBUG IdleTimeout: SocketChannelEndPoint@45e789ce{/172.31.35.212:47064<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@a1d7539[p=HttpParser{s=END,0 of 0},g=HttpGenerator@73cd344d{s=START}]=>HttpChannelOverHttp@4b207f02{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-62_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=570023} idle timeout expired
21/06/23 22:45:10 DEBUG FillInterest: onFail FillInterest@3bdd9d59{null}
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/23 22:45:10 DEBUG WriteFlusher: ignored: WriteFlusher@6c52820e{IDLE}->null
java.util.concurrent.TimeoutException: Idle timeout expired: 30000/30000 ms
at org.apache.hudi.org.apache.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:166)
at org.apache.hudi.org.apache.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
21/06/23 22:45:10 DEBUG AbstractEndPoint: Ignored idle endpoint SocketChannelEndPoint@45e789ce{/172.31.35.212:47064<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@a1d7539[p=HttpParser{s=END,0 of 0},g=HttpGenerator@73cd344d{s=START}]=>HttpChannelOverHttp@4b207f02{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-62_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=570023}
21/06/23 22:45:10 DEBUG HttpChannelState: onTimeout HttpChannelState@4f1fe2be{s=ASYNC_WAIT a=STARTED i=false r=IDLE w=false}
21/06/23 22:45:10 DEBUG HttpChannelState: Dispatch after async timeout HttpChannelState@4f1fe2be{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/23 22:45:10 DEBUG HttpChannel: HttpChannelOverHttp@4b207f02{r=1,c=false,c=false/false,a=ASYNC_WOKEN,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-62_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=570025} handle //ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-62_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
21/06/23 22:45:10 DEBUG HttpChannelState: handling HttpChannelState@4f1fe2be{s=ASYNC_WOKEN a=EXPIRED i=false r=IDLE w=false}
21/06/23 22:45:10 DEBUG HttpChannel: HttpChannelOverHttp@4b207f02{r=1,c=false,c=false/false,a=DISPATCHED,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-62_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=570025} action ERROR_DISPATCH
21/06/23 22:45:10 DEBUG RequestHandler: TimeTakenMillis[Total=0, Refresh=0, handle=0, Check=0], Success=true, Query=markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-62_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, Host=ip-172-31-35-80.us-east-2.compute.internal:37099, synced=false
21/06/23 22:45:10 DEBUG HttpChannelState: startAsync HttpChannelState@4f1fe2be{s=DISPATCHED a=NOT_ASYNC i=false r=IDLE w=false}
21/06/23 22:45:10 DEBUG HttpChannelState: unhandle HttpChannelState@4f1fe2be{s=DISPATCHED a=STARTED i=false r=IDLE w=false}
21/06/23 22:45:10 DEBUG HttpChannel: HttpChannelOverHttp@4b207f02{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-62_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=570026} action WAIT
21/06/23 22:45:10 DEBUG HttpChannel: HttpChannelOverHttp@4b207f02{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-62_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=570026} handle exit, result WAIT
21/06/23 22:45:39 DEBUG IdleTimeout: SocketChannelEndPoint@3b772bac{/172.31.35.212:46962<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30000/30000}{io=0/0,kio=0,kro=1}->HttpConnection@21fc48c2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@7dbf8533{s=START}]=>HttpChannelOverHttp@596f6a9a{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-59_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1500051} idle timeout check, elapsed: 30000 ms, remaining: 0 ms
21/06/23 22:45:39 DEBUG IdleTimeout: SocketChannelEndPoint@3b772bac{/172.31.35.212:46962<->/172.31.35.80:37099,OPEN,fill=-,flush=-,to=30001/30000}{io=0/0,kio=0,kro=1}->HttpConnection@21fc48c2[p=HttpParser{s=END,0 of 0},g=HttpGenerator@7dbf8533{s=START}]=>HttpChannelOverHttp@596f6a9a{r=1,c=false,c=false/false,a=ASYNC_WAIT,uri=//ip-172-31-35-80.us-east-2.compute.internal:37099/v1/hoodie/view/marker/create?markername=2020-02-01%2F69e5b4da-e883-4568-8aea-80a17594f56a-0_0-5-59_20210623221959.parquet.marker.CREATE&markerdirpath=s3a%3A%2F%2Fsiva-test-bucket-june-16%2Fhudi_testing%2Fhudi_base_105%2F.hoodie%2F.temp%2F20210623221959&timelinehash=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,age=1500051} idle timeout expired
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment