Skip to content

Instantly share code, notes, and snippets.

@rmetzger

rmetzger/gist:ca5a0f30ebc4d1852180570889e07242

Created February 12, 2020 12:10
Show Gist options
  • Save rmetzger/ca5a0f30ebc4d1852180570889e07242 to your computer and use it in GitHub Desktop.
Save rmetzger/ca5a0f30ebc4d1852180570889e07242 to your computer and use it in GitHub Desktop.
Download ZIP
Flink 1.11 AskTimeoutException
Raw
gistfile1.txt
This excerpt is taken from https://dev.azure.com/rmetzger/Flink/_build/results?buildId=4940&view=results
2020-02-07T11:38:27.0968542Z [FAIL] Test script contains errors.
2020-02-07T11:38:27.0980571Z Checking for errors...
2020-02-07T11:38:27.1067102Z Found error in log files:
2020-02-07T11:38:27.1081555Z 2020-02-07 11:27:50,918 INFO org.apache.flink.client.cli.CliFrontend - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1082318Z 2020-02-07 11:27:50,919 INFO org.apache.flink.client.cli.CliFrontend - Starting Command Line Client (Version: 1.11-SNAPSHOT, Rev:e682fc5, Date:07.02.2020 @ 10:01:55 UTC)
2020-02-07T11:38:27.1082804Z 2020-02-07 11:27:50,919 INFO org.apache.flink.client.cli.CliFrontend - OS current user: agent1_azpcontainer
2020-02-07T11:38:27.1083188Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - Current Hadoop/Kerberos user: <no hadoop dependency found>
2020-02-07T11:38:27.1083911Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - JVM: OpenJDK 64-Bit Server VM - Private Build - 1.8/25.242-b08
2020-02-07T11:38:27.1084239Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - Maximum heap size: 14281 MiBytes
2020-02-07T11:38:27.1084699Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
2020-02-07T11:38:27.1085116Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - No Hadoop Dependency available
2020-02-07T11:38:27.1085627Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - JVM Options:
2020-02-07T11:38:27.1086266Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - -Dlog.file=/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/log/flink--client-a3cca9d01479.log
2020-02-07T11:38:27.1086992Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - -Dlog4j.configuration=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/log4j-cli.properties
2020-02-07T11:38:27.1087705Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - -Dlogback.configurationFile=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/logback.xml
2020-02-07T11:38:27.1088236Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - Program Arguments:
2020-02-07T11:38:27.1088703Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - run
2020-02-07T11:38:27.1089394Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - -p
2020-02-07T11:38:27.1090082Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - 1
2020-02-07T11:38:27.1090728Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/examples/batch/WordCount.jar
2020-02-07T11:38:27.1091367Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - --input
2020-02-07T11:38:27.1091857Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - s3://test-data/words
2020-02-07T11:38:27.1092337Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - --output
2020-02-07T11:38:27.1092926Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - s3://test-data/temp/test_batch_wordcount-81721a95-6958-4fa2-944e-72ae0a8681f4
2020-02-07T11:38:27.1094151Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - Classpath: /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table-blink_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/log4j-1.2.17.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/slf4j-log4j12-1.7.15.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-dist_2.11-1.11-SNAPSHOT.jar:::
2020-02-07T11:38:27.1094669Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1095046Z 2020-02-07 11:27:50,927 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1095403Z 2020-02-07 11:27:50,927 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1095892Z 2020-02-07 11:27:50,927 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1096248Z 2020-02-07 11:27:50,927 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1096625Z 2020-02-07 11:27:50,927 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1096984Z 2020-02-07 11:27:50,928 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1097345Z 2020-02-07 11:27:50,928 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1097728Z 2020-02-07 11:27:50,929 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1098065Z 2020-02-07 11:27:50,929 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1098432Z 2020-02-07 11:27:50,929 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1098774Z 2020-02-07 11:27:50,930 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1099194Z 2020-02-07 11:27:50,930 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1099665Z 2020-02-07 11:27:50,930 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1100015Z 2020-02-07 11:27:50,930 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1100367Z 2020-02-07 11:27:50,930 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1100721Z 2020-02-07 11:27:50,933 WARN org.apache.flink.client.cli.CliFrontend - Could not load CLI class org.apache.flink.yarn.cli.FlinkYarnSessionCli.
2020-02-07T11:38:27.1100843Z java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException
2020-02-07T11:38:27.1100921Z at java.lang.Class.forName0(Native Method)
2020-02-07T11:38:27.1101159Z at java.lang.Class.forName(Class.java:264)
2020-02-07T11:38:27.1101295Z at org.apache.flink.client.cli.CliFrontend.loadCustomCommandLine(CliFrontend.java:1076)
2020-02-07T11:38:27.1101432Z at org.apache.flink.client.cli.CliFrontend.loadCustomCommandLines(CliFrontend.java:1030)
2020-02-07T11:38:27.1101524Z at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:957)
2020-02-07T11:38:27.1101634Z Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.exceptions.YarnException
2020-02-07T11:38:27.1101719Z at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
2020-02-07T11:38:27.1101812Z at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
2020-02-07T11:38:27.1101891Z at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
2020-02-07T11:38:27.1101982Z at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
2020-02-07T11:38:27.1102048Z ... 5 more
2020-02-07T11:38:27.1102461Z 2020-02-07 11:27:51,045 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2020-02-07T11:38:27.1102869Z 2020-02-07 11:27:51,098 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1103364Z 2020-02-07 11:27:51,112 INFO org.apache.flink.runtime.security.modules.JaasModule - Jaas file will be created as /tmp/jaas-3983648475548474258.conf.
2020-02-07T11:38:27.1103889Z 2020-02-07 11:27:51,115 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1104207Z 2020-02-07 11:27:51,116 INFO org.apache.flink.client.cli.CliFrontend - Running 'run' command.
2020-02-07T11:38:27.1104533Z 2020-02-07 11:27:51,121 INFO org.apache.flink.client.cli.CliFrontend - Building program from JAR file
2020-02-07T11:38:27.1104846Z 2020-02-07 11:27:51,136 INFO org.apache.flink.client.ClientUtils - Starting program (detached: false)
2020-02-07T11:38:27.1105214Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1105580Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1105924Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1106292Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1106642Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1107101Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1107470Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1107834Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1108171Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1108537Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1108894Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1109395Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1109754Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1110082Z 2020-02-07 11:27:51,171 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1110416Z 2020-02-07 11:27:51,171 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1110752Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1111294Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1111754Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1112097Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1112455Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1112783Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1113147Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1113488Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1113959Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1114311Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1114643Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1114983Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1115409Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1115763Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1116081Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1116430Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1116760Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1117105Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1117465Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1117812Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1118153Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1118500Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1118848Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1119227Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1119669Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1120013Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1120342Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1120688Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1121154Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1121525Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1121865Z 2020-02-07 11:27:51,239 INFO org.apache.flink.api.java.ExecutionEnvironment - The job has 0 registered types and 0 default Kryo serializers
2020-02-07T11:38:27.1122344Z 2020-02-07 11:27:51,471 INFO org.apache.commons.beanutils.FluentPropertyBeanIntrospector - Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property.
2020-02-07T11:38:27.1122768Z 2020-02-07 11:27:51,481 WARN org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties
2020-02-07T11:38:27.1123106Z 2020-02-07 11:27:51,542 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - Scheduled Metric snapshot period at 10 second(s).
2020-02-07T11:38:27.1123544Z 2020-02-07 11:27:51,542 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - s3a-file-system metrics system started
2020-02-07T11:38:27.1124117Z 2020-02-07 11:38:08,935 WARN org.apache.flink.api.common.io.DelimitedInputFormat - Could not determine statistics for files '[s3://test-data/words]' due to an io error: doesBucketExist on test-data: com.amazonaws.SdkClientException: Unable to execute HTTP request: minio: Unable to execute HTTP request: minio
2020-02-07T11:38:27.1124515Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1124869Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1125202Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1125566Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1125929Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1126258Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1126627Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1126982Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1127318Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1127771Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1128105Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1128448Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1128795Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1129177Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1129528Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1129898Z 2020-02-07 11:38:09,054 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2020-02-07T11:38:27.1130261Z 2020-02-07 11:38:24,743 WARN org.apache.flink.util.ExecutorUtils - ExecutorService did not terminate in time. Shutting it down now.
2020-02-07T11:38:27.1130585Z 2020-02-07 11:38:24,746 ERROR org.apache.flink.client.cli.CliFrontend - Error while running the command.
2020-02-07T11:38:27.1130718Z org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: java.util.concurrent.ExecutionException: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
2020-02-07T11:38:27.1131042Z at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:335)
2020-02-07T11:38:27.1131214Z at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
2020-02-07T11:38:27.1131309Z at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:138)
2020-02-07T11:38:27.1131408Z at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:664)
2020-02-07T11:38:27.1131487Z at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:213)
2020-02-07T11:38:27.1131579Z at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:895)
2020-02-07T11:38:27.1131660Z at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:968)
2020-02-07T11:38:27.1131762Z at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
2020-02-07T11:38:27.1131843Z at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:968)
2020-02-07T11:38:27.1131970Z Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
2020-02-07T11:38:27.1132077Z at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:199)
2020-02-07T11:38:27.1132180Z at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:952)
2020-02-07T11:38:27.1132269Z at org.apache.flink.client.program.ContextEnvironment.executeAsync(ContextEnvironment.java:84)
2020-02-07T11:38:27.1132372Z at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:53)
2020-02-07T11:38:27.1132470Z at org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:93)
2020-02-07T11:38:27.1132548Z at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-02-07T11:38:27.1132639Z at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-02-07T11:38:27.1132729Z at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-02-07T11:38:27.1132820Z at java.lang.reflect.Method.invoke(Method.java:498)
2020-02-07T11:38:27.1132977Z at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:321)
2020-02-07T11:38:27.1133063Z ... 8 more
2020-02-07T11:38:27.1133143Z Caused by: java.util.concurrent.ExecutionException: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
2020-02-07T11:38:27.1133249Z at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
2020-02-07T11:38:27.1133329Z at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
2020-02-07T11:38:27.1133424Z at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:947)
2020-02-07T11:38:27.1133498Z ... 16 more
2020-02-07T11:38:27.1133658Z Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
2020-02-07T11:38:27.1133755Z at org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$7(RestClusterClient.java:359)
2020-02-07T11:38:27.1133865Z at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884)
2020-02-07T11:38:27.1133950Z at java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:866)
2020-02-07T11:38:27.1134048Z at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-02-07T11:38:27.1134134Z at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
2020-02-07T11:38:27.1134236Z at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$8(FutureUtils.java:274)
2020-02-07T11:38:27.1134324Z at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-02-07T11:38:27.1134422Z at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-02-07T11:38:27.1134616Z at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-02-07T11:38:27.1134715Z at java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:575)
2020-02-07T11:38:27.1134804Z at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:943)
2020-02-07T11:38:27.1134906Z at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456)
2020-02-07T11:38:27.1134988Z at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2020-02-07T11:38:27.1135087Z at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2020-02-07T11:38:27.1135157Z at java.lang.Thread.run(Thread.java:748)
2020-02-07T11:38:27.1135255Z Caused by: org.apache.flink.runtime.rest.util.RestClientException: [Internal server error., <Exception on server side:
2020-02-07T11:38:27.1135773Z akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/dispatcher#-939201095]] after [10000 ms]. Message of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply.
2020-02-07T11:38:27.1135936Z at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-02-07T11:38:27.1136029Z at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-02-07T11:38:27.1136108Z at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:648)
2020-02-07T11:38:27.1136202Z at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205)
2020-02-07T11:38:27.1136282Z at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)
2020-02-07T11:38:27.1136381Z at scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)
2020-02-07T11:38:27.1136461Z at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
2020-02-07T11:38:27.1136566Z at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328)
2020-02-07T11:38:27.1136667Z at akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:279)
2020-02-07T11:38:27.1136845Z at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:283)
2020-02-07T11:38:27.1136933Z at akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:235)
2020-02-07T11:38:27.1137025Z at java.lang.Thread.run(Thread.java:748)
2020-02-07T11:38:27.1137069Z
2020-02-07T11:38:27.1137141Z End of exception on server side>]
2020-02-07T11:38:27.1137213Z at org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:390)
2020-02-07T11:38:27.1137308Z at org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:374)
2020-02-07T11:38:27.1137388Z at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:966)
2020-02-07T11:38:27.1137487Z at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940)
2020-02-07T11:38:27.1137564Z ... 4 more
2020-02-07T11:38:27.1137920Z 2020-02-07 11:27:47,895 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1138333Z 2020-02-07 11:27:47,897 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneSessionClusterEntrypoint (Version: 1.11-SNAPSHOT, Rev:e682fc5, Date:07.02.2020 @ 10:01:55 UTC)
2020-02-07T11:38:27.1138682Z 2020-02-07 11:27:47,897 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - OS current user: agent1_azpcontainer
2020-02-07T11:38:27.1139055Z 2020-02-07 11:27:47,898 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Current Hadoop/Kerberos user: <no hadoop dependency found>
2020-02-07T11:38:27.1139423Z 2020-02-07 11:27:47,898 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM: OpenJDK 64-Bit Server VM - Private Build - 1.8/25.242-b08
2020-02-07T11:38:27.1139830Z 2020-02-07 11:27:47,898 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Maximum heap size: 981 MiBytes
2020-02-07T11:38:27.1140155Z 2020-02-07 11:27:47,898 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
2020-02-07T11:38:27.1140471Z 2020-02-07 11:27:47,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - No Hadoop Dependency available
2020-02-07T11:38:27.1140753Z 2020-02-07 11:27:47,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM Options:
2020-02-07T11:38:27.1141230Z 2020-02-07 11:27:47,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xms1024m
2020-02-07T11:38:27.1141563Z 2020-02-07 11:27:47,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xmx1024m
2020-02-07T11:38:27.1141986Z 2020-02-07 11:27:47,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlog.file=/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/log/flink--standalonesession-0-a3cca9d01479.log
2020-02-07T11:38:27.1142428Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlog4j.configuration=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/log4j.properties
2020-02-07T11:38:27.1142849Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlogback.configurationFile=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/logback.xml
2020-02-07T11:38:27.1143181Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Program Arguments:
2020-02-07T11:38:27.1143481Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --configDir
2020-02-07T11:38:27.1143895Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf
2020-02-07T11:38:27.1144227Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --executionMode
2020-02-07T11:38:27.1144610Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - cluster
2020-02-07T11:38:27.1145449Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Classpath: /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table-blink_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/log4j-1.2.17.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/slf4j-log4j12-1.7.15.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-dist_2.11-1.11-SNAPSHOT.jar:::
2020-02-07T11:38:27.1145936Z 2020-02-07 11:27:47,901 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1146287Z 2020-02-07 11:27:47,902 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Registered UNIX signal handlers for [TERM, HUP, INT]
2020-02-07T11:38:27.1146627Z 2020-02-07 11:27:47,921 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1146975Z 2020-02-07 11:27:47,921 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1147308Z 2020-02-07 11:27:47,922 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1147668Z 2020-02-07 11:27:47,922 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1148098Z 2020-02-07 11:27:47,922 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1148448Z 2020-02-07 11:27:47,922 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1148807Z 2020-02-07 11:27:47,923 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1149194Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1149540Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1149880Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1150233Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1150561Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1150912Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1151428Z 2020-02-07 11:27:47,925 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1151753Z 2020-02-07 11:27:47,925 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1152090Z 2020-02-07 11:27:47,997 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneSessionClusterEntrypoint.
2020-02-07T11:38:27.1152488Z 2020-02-07 11:27:47,997 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install default filesystem.
2020-02-07T11:38:27.1152885Z 2020-02-07 11:27:48,042 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2020-02-07T11:38:27.1153202Z 2020-02-07 11:27:48,070 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install security context.
2020-02-07T11:38:27.1153629Z 2020-02-07 11:27:48,078 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1154000Z 2020-02-07 11:27:48,083 INFO org.apache.flink.runtime.security.modules.JaasModule - Jaas file will be created as /tmp/jaas-1463730351068169936.conf.
2020-02-07T11:38:27.1154369Z 2020-02-07 11:27:48,085 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1154700Z 2020-02-07 11:27:48,086 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Initializing cluster services.
2020-02-07T11:38:27.1155015Z 2020-02-07 11:27:48,110 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at localhost:6123
2020-02-07T11:38:27.1155326Z 2020-02-07 11:27:48,558 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2020-02-07T11:38:27.1155630Z 2020-02-07 11:27:48,579 INFO akka.remote.Remoting - Starting remoting
2020-02-07T11:38:27.1155970Z 2020-02-07 11:27:48,686 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://flink@localhost:6123]
2020-02-07T11:38:27.1156406Z 2020-02-07 11:27:48,743 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://flink@localhost:6123
2020-02-07T11:38:27.1156780Z 2020-02-07 11:27:48,833 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2020-02-07T11:38:27.1157183Z 2020-02-07 11:27:48,840 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /tmp/blobStore-15b15eb1-9d1b-4668-9bc4-136ca053014f
2020-02-07T11:38:27.1157558Z 2020-02-07 11:27:48,843 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:41085 - max concurrent requests: 50 - max backlog: 1000
2020-02-07T11:38:27.1157919Z 2020-02-07 11:27:48,852 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No metrics reporter configured, no metrics will be exposed/reported.
2020-02-07T11:38:27.1158262Z 2020-02-07 11:27:48,855 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at localhost:0
2020-02-07T11:38:27.1158565Z 2020-02-07 11:27:48,871 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2020-02-07T11:38:27.1158865Z 2020-02-07 11:27:48,873 INFO akka.remote.Remoting - Starting remoting
2020-02-07T11:38:27.1159264Z 2020-02-07 11:27:48,881 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://flink-metrics@localhost:38313]
2020-02-07T11:38:27.1159624Z 2020-02-07 11:27:48,887 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://flink-metrics@localhost:38313
2020-02-07T11:38:27.1160025Z 2020-02-07 11:27:48,892 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/MetricQueryService .
2020-02-07T11:38:27.1160631Z 2020-02-07 11:27:48,953 INFO org.apache.flink.runtime.dispatcher.FileArchivedExecutionGraphStore - Initializing FileArchivedExecutionGraphStore: Storage directory /tmp/executionGraphStore-157dd226-fdb1-4436-9270-f3dd8408151a, expiration time 3600000, maximum cache size 52428800 bytes.
2020-02-07T11:38:27.1161190Z 2020-02-07 11:27:48,989 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2020-02-07T11:38:27.1161681Z 2020-02-07 11:27:48,989 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'rest.port' instead of key 'rest.bind-port'
2020-02-07T11:38:27.1162093Z 2020-02-07 11:27:48,990 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Upload directory /tmp/flink-web-1b994d2a-a9d0-4687-b2d9-5b8b605b23d6/flink-web-upload does not exist.
2020-02-07T11:38:27.1162512Z 2020-02-07 11:27:48,990 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Created directory /tmp/flink-web-1b994d2a-a9d0-4687-b2d9-5b8b605b23d6/flink-web-upload for file uploads.
2020-02-07T11:38:27.1162829Z 2020-02-07 11:27:48,991 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Starting rest endpoint.
2020-02-07T11:38:27.1163292Z 2020-02-07 11:27:49,166 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils - Determined location of main cluster component log file: /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/log/flink--standalonesession-0-a3cca9d01479.log
2020-02-07T11:38:27.1163832Z 2020-02-07 11:27:49,166 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils - Determined location of main cluster component stdout file: /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/log/flink--standalonesession-0-a3cca9d01479.out
2020-02-07T11:38:27.1164472Z 2020-02-07 11:27:49,309 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Rest endpoint listening at localhost:8081
2020-02-07T11:38:27.1164861Z 2020-02-07 11:27:49,310 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - http://localhost:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
2020-02-07T11:38:27.1165211Z 2020-02-07 11:27:49,310 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Web frontend listening at http://localhost:8081.
2020-02-07T11:38:27.1165614Z 2020-02-07 11:27:49,320 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/resourcemanager .
2020-02-07T11:38:27.1165976Z 2020-02-07 11:27:49,340 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess - Start SessionDispatcherLeaderProcess.
2020-02-07T11:38:27.1166300Z 2020-02-07 11:27:49,342 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess - Recover all persisted job graphs.
2020-02-07T11:38:27.1166655Z 2020-02-07 11:27:49,342 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess - Successfully recovered 0 persisted job graphs.
2020-02-07T11:38:27.1167100Z 2020-02-07 11:27:49,345 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - ResourceManager akka.tcp://flink@localhost:6123/user/resourcemanager was granted leadership with fencing token 00000000000000000000000000000000
2020-02-07T11:38:27.1167507Z 2020-02-07 11:27:49,347 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/dispatcher .
2020-02-07T11:38:27.1167842Z 2020-02-07 11:27:49,349 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Starting the SlotManager.
2020-02-07T11:38:27.1168284Z 2020-02-07 11:27:50,299 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Registering TaskManager with ResourceID 7722ce213a196a9126c849ff4f6b42cd (akka.tcp://[email protected]:44825/user/taskmanager_0) at ResourceManager
2020-02-07T11:38:27.1168779Z 2020-02-07 11:38:09,650 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Received JobGraph submission 34ffd3de4a8b9a7d4ef8ac924e913d66 (WordCount Example).
2020-02-07T11:38:27.1169206Z 2020-02-07 11:38:09,650 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Submitting job 34ffd3de4a8b9a7d4ef8ac924e913d66 (WordCount Example).
2020-02-07T11:38:27.1169593Z 2020-02-07 11:38:09,667 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/jobmanager_0 .
2020-02-07T11:38:27.1169971Z 2020-02-07 11:38:09,673 INFO org.apache.flink.runtime.jobmaster.JobMaster - Initializing job WordCount Example (34ffd3de4a8b9a7d4ef8ac924e913d66).
2020-02-07T11:38:27.1170385Z 2020-02-07 11:38:09,690 INFO org.apache.flink.runtime.jobmaster.JobMaster - Using restart back off time strategy NoRestartBackoffTimeStrategy for WordCount Example (34ffd3de4a8b9a7d4ef8ac924e913d66).
2020-02-07T11:38:27.1170805Z 2020-02-07 11:38:09,718 INFO org.apache.flink.runtime.jobmaster.JobMaster - Running initialization on master for job WordCount Example (34ffd3de4a8b9a7d4ef8ac924e913d66).
2020-02-07T11:38:27.1171341Z 2020-02-07 11:38:09,730 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1171680Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1172030Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1172473Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1172841Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1173169Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1173731Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1174296Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1174882Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1175461Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1176007Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1176562Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1177120Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1177676Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1178199Z 2020-02-07 11:38:09,732 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1178951Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1179518Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1180053Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1180617Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1181274Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1181848Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1182392Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1182967Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1183508Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1184205Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1184901Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1185452Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1185834Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1186162Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1186506Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1186977Z 2020-02-07 11:38:09,952 INFO org.apache.commons.beanutils.FluentPropertyBeanIntrospector - Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property.
2020-02-07T11:38:27.1187403Z 2020-02-07 11:38:09,962 WARN org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties
2020-02-07T11:38:27.1187752Z 2020-02-07 11:38:09,982 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - Scheduled Metric snapshot period at 10 second(s).
2020-02-07T11:38:27.1188063Z 2020-02-07 11:38:09,982 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - s3a-file-system metrics system started
2020-02-07T11:38:27.1188450Z 2020-02-07 11:38:10,004 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2020-02-07T11:38:27.1188763Z 2020-02-07 11:38:19,669 ERROR org.apache.flink.runtime.rest.handler.job.JobSubmitHandler - Unhandled exception.
2020-02-07T11:38:27.1189393Z akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/dispatcher#-939201095]] after [10000 ms]. Message of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply.
2020-02-07T11:38:27.1189538Z at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-02-07T11:38:27.1189616Z at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-02-07T11:38:27.1189713Z at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:648)
2020-02-07T11:38:27.1189789Z at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205)
2020-02-07T11:38:27.1189883Z at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)
2020-02-07T11:38:27.1189973Z at scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)
2020-02-07T11:38:27.1190067Z at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
2020-02-07T11:38:27.1190159Z at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328)
2020-02-07T11:38:27.1190267Z at akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:279)
2020-02-07T11:38:27.1190358Z at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:283)
2020-02-07T11:38:27.1190465Z at akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:235)
2020-02-07T11:38:27.1190540Z at java.lang.Thread.run(Thread.java:748)
2020-02-07T11:38:27.1190886Z 2020-02-07 11:27:48,619 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1191418Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Preconfiguration:
2020-02-07T11:38:27.1191864Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
2020-02-07T11:38:27.1191930Z
2020-02-07T11:38:27.1191965Z
2020-02-07T11:38:27.1192040Z TM_RESOURCES_JVM_PARAMS extraction logs:
2020-02-07T11:38:27.1192265Z - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1192509Z - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1192731Z - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1192985Z - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1193215Z - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1193448Z - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1193757Z - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1194011Z - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1194228Z - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1194473Z - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1194694Z - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1194933Z - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1195154Z - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1195387Z - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1195598Z - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1195949Z - The derived from fraction jvm overhead memory (156.800mb (164416719 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead
2020-02-07T11:38:27.1196260Z BASH_JAVA_UTILS_EXEC_RESULT:-Xmx536870902 -Xms536870902 -XX:MaxDirectMemorySize=268435458 -XX:MaxMetaspaceSize=100663296
2020-02-07T11:38:27.1196342Z
2020-02-07T11:38:27.1196401Z TM_RESOURCES_DYNAMIC_CONFIGS extraction logs:
2020-02-07T11:38:27.1196734Z - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1196957Z - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1197195Z - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1197426Z - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1197674Z - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1197893Z - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1198144Z - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1198501Z - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1198872Z - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1199254Z - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1199583Z - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1199816Z - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1200055Z - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1200274Z - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1200500Z - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1200830Z - The derived from fraction jvm overhead memory (156.800mb (164416719 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead
2020-02-07T11:38:27.1201584Z BASH_JAVA_UTILS_EXEC_RESULT:-D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=134217730b -D taskmanager.memory.network.min=134217730b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=536870920b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=402653174b -D taskmanager.memory.task.off-heap.size=0b
2020-02-07T11:38:27.1201819Z
2020-02-07T11:38:27.1202177Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1202559Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Starting TaskManager (Version: 1.11-SNAPSHOT, Rev:e682fc5, Date:07.02.2020 @ 10:01:55 UTC)
2020-02-07T11:38:27.1202905Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - OS current user: agent1_azpcontainer
2020-02-07T11:38:27.1203253Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Current Hadoop/Kerberos user: <no hadoop dependency found>
2020-02-07T11:38:27.1203680Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - JVM: OpenJDK 64-Bit Server VM - Private Build - 1.8/25.242-b08
2020-02-07T11:38:27.1204024Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Maximum heap size: 512 MiBytes
2020-02-07T11:38:27.1204362Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
2020-02-07T11:38:27.1204666Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - No Hadoop Dependency available
2020-02-07T11:38:27.1204968Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - JVM Options:
2020-02-07T11:38:27.1205249Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -XX:+UseG1GC
2020-02-07T11:38:27.1205552Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -Xmx536870902
2020-02-07T11:38:27.1205837Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -Xms536870902
2020-02-07T11:38:27.1206163Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -XX:MaxDirectMemorySize=268435458
2020-02-07T11:38:27.1206557Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -XX:MaxMetaspaceSize=100663296
2020-02-07T11:38:27.1206972Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -Dlog.file=/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/log/flink--taskexecutor-0-a3cca9d01479.log
2020-02-07T11:38:27.1207400Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -Dlog4j.configuration=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/log4j.properties
2020-02-07T11:38:27.1207816Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -Dlogback.configurationFile=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/logback.xml
2020-02-07T11:38:27.1208155Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Program Arguments:
2020-02-07T11:38:27.1208465Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - --configDir
2020-02-07T11:38:27.1208812Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf
2020-02-07T11:38:27.1209167Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1209496Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.framework.off-heap.size=134217728b
2020-02-07T11:38:27.1209798Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1210211Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.network.max=134217730b
2020-02-07T11:38:27.1210500Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1210825Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.network.min=134217730b
2020-02-07T11:38:27.1211311Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1211657Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.framework.heap.size=134217728b
2020-02-07T11:38:27.1211943Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1212272Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.managed.size=536870920b
2020-02-07T11:38:27.1212558Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1212876Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.cpu.cores=1.0
2020-02-07T11:38:27.1213153Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1213484Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.task.heap.size=402653174b
2020-02-07T11:38:27.1213826Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1214150Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.task.off-heap.size=0b
2020-02-07T11:38:27.1214992Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Classpath: /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table-blink_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/log4j-1.2.17.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/slf4j-log4j12-1.7.15.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-dist_2.11-1.11-SNAPSHOT.jar:::
2020-02-07T11:38:27.1215586Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1215915Z 2020-02-07 11:27:48,624 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Registered UNIX signal handlers for [TERM, HUP, INT]
2020-02-07T11:38:27.1216256Z 2020-02-07 11:27:48,628 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Maximum number of open file descriptors is 1048576.
2020-02-07T11:38:27.1216608Z 2020-02-07 11:27:48,641 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1216956Z 2020-02-07 11:27:48,641 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1217303Z 2020-02-07 11:27:48,642 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1217644Z 2020-02-07 11:27:48,642 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1217996Z 2020-02-07 11:27:48,642 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1218409Z 2020-02-07 11:27:48,642 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1218784Z 2020-02-07 11:27:48,642 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1219163Z 2020-02-07 11:27:48,643 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1219514Z 2020-02-07 11:27:48,643 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1219847Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1220201Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1220553Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1220891Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1221425Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1221750Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1222148Z 2020-02-07 11:27:48,746 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2020-02-07T11:38:27.1222549Z 2020-02-07 11:27:48,790 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1223006Z 2020-02-07 11:27:48,804 INFO org.apache.flink.runtime.security.modules.JaasModule - Jaas file will be created as /tmp/jaas-1199271464048060563.conf.
2020-02-07T11:38:27.1223383Z 2020-02-07 11:27:48,807 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1223822Z 2020-02-07 11:27:48,863 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2020-02-07T11:38:27.1224223Z 2020-02-07 11:27:48,872 INFO org.apache.flink.runtime.util.LeaderRetrievalUtils - Trying to select the network interface and address to use by connecting to the leading JobManager.
2020-02-07T11:38:27.1224606Z 2020-02-07 11:27:48,872 INFO org.apache.flink.runtime.util.LeaderRetrievalUtils - TaskManager will try to connect for PT10S before falling back to heuristics
2020-02-07T11:38:27.1224952Z 2020-02-07 11:27:48,950 INFO org.apache.flink.runtime.net.ConnectionUtils - Retrieved new target address localhost/127.0.0.1:6123.
2020-02-07T11:38:27.1225336Z 2020-02-07 11:27:48,955 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - TaskManager will use hostname/address 'a3cca9d01479' (192.168.64.2) for communication.
2020-02-07T11:38:27.1225666Z 2020-02-07 11:27:48,963 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at 192.168.64.2:0
2020-02-07T11:38:27.1225979Z 2020-02-07 11:27:49,351 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2020-02-07T11:38:27.1226280Z 2020-02-07 11:27:49,373 INFO akka.remote.Remoting - Starting remoting
2020-02-07T11:38:27.1226721Z 2020-02-07 11:27:49,493 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://[email protected]:44825]
2020-02-07T11:38:27.1227083Z 2020-02-07 11:27:49,576 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://[email protected]:44825
2020-02-07T11:38:27.1227426Z 2020-02-07 11:27:49,589 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No metrics reporter configured, no metrics will be exposed/reported.
2020-02-07T11:38:27.1227770Z 2020-02-07 11:27:49,592 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at 192.168.64.2:0
2020-02-07T11:38:27.1228065Z 2020-02-07 11:27:49,608 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2020-02-07T11:38:27.1228364Z 2020-02-07 11:27:49,611 INFO akka.remote.Remoting - Starting remoting
2020-02-07T11:38:27.1228726Z 2020-02-07 11:27:49,619 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://[email protected]:45750]
2020-02-07T11:38:27.1229154Z 2020-02-07 11:27:49,628 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://[email protected]:45750
2020-02-07T11:38:27.1229620Z 2020-02-07 11:27:49,633 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/MetricQueryService_7722ce213a196a9126c849ff4f6b42cd .
2020-02-07T11:38:27.1230016Z 2020-02-07 11:27:49,648 INFO org.apache.flink.runtime.blob.PermanentBlobCache - Created BLOB cache storage directory /tmp/blobStore-fab5a5b4-4fb2-40ef-98de-cead95d128c7
2020-02-07T11:38:27.1230417Z 2020-02-07 11:27:49,651 INFO org.apache.flink.runtime.blob.TransientBlobCache - Created BLOB cache storage directory /tmp/blobStore-137d52c7-b288-48f5-87dc-bc327caf599f
2020-02-07T11:38:27.1230875Z 2020-02-07 11:27:49,651 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Starting TaskManager with ResourceID: 7722ce213a196a9126c849ff4f6b42cd
2020-02-07T11:38:27.1231319Z 2020-02-07 11:27:49,709 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices - Temporary file directory '/tmp': total 125 GB, usable 77 GB (61.60% usable)
2020-02-07T11:38:27.1231722Z 2020-02-07 11:27:49,712 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager uses directory /tmp/flink-io-9bf5d7ea-9a0d-46c2-bfbe-20de9f382f6b for spill files.
2020-02-07T11:38:27.1232373Z 2020-02-07 11:27:49,720 INFO org.apache.flink.runtime.io.network.netty.NettyConfig - NettyConfig [server address: /192.168.64.2, server port: 0, ssl enabled: false, memory segment size (bytes): 32768, transport type: AUTO, number of server threads: 1 (manual), number of client threads: 1 (manual), server connect backlog: 0 (use Netty's default), client connect timeout (sec): 120, send/receive buffer size (bytes): 0 (use Netty's default)]
2020-02-07T11:38:27.1232876Z 2020-02-07 11:27:49,722 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager uses directory /tmp/flink-netty-shuffle-8ef69a51-79bb-431e-80f6-c4209d6e6bf5 for spill files.
2020-02-07T11:38:27.1233299Z 2020-02-07 11:27:49,879 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated 128 MB for network buffer pool (number of memory segments: 4096, bytes per segment: 32768).
2020-02-07T11:38:27.1233711Z 2020-02-07 11:27:49,886 INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Starting the network environment and its components.
2020-02-07T11:38:27.1234025Z 2020-02-07 11:27:49,939 INFO org.apache.flink.runtime.io.network.netty.NettyClient - Transport type 'auto': using EPOLL.
2020-02-07T11:38:27.1234449Z 2020-02-07 11:27:49,941 INFO org.apache.flink.runtime.io.network.netty.NettyClient - Successful initialization (took 54 ms).
2020-02-07T11:38:27.1234767Z 2020-02-07 11:27:49,945 INFO org.apache.flink.runtime.io.network.netty.NettyServer - Transport type 'auto': using EPOLL.
2020-02-07T11:38:27.1235146Z 2020-02-07 11:27:49,975 INFO org.apache.flink.runtime.io.network.netty.NettyServer - Successful initialization (took 33 ms). Listening on SocketAddress /192.168.64.2:34742.
2020-02-07T11:38:27.1235475Z 2020-02-07 11:27:49,976 INFO org.apache.flink.runtime.taskexecutor.KvStateService - Starting the kvState service and its components.
2020-02-07T11:38:27.1235809Z 2020-02-07 11:27:49,984 INFO org.apache.flink.runtime.taskexecutor.TaskManagerConfiguration - Messages have a max timeout of 300000 ms
2020-02-07T11:38:27.1236201Z 2020-02-07 11:27:49,992 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/taskmanager_0 .
2020-02-07T11:38:27.1236521Z 2020-02-07 11:27:50,002 INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Start job leader service.
2020-02-07T11:38:27.1236916Z 2020-02-07 11:27:50,003 INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory /tmp/flink-dist-cache-f0574260-6be5-4a14-812e-ee00c8c44171
2020-02-07T11:38:27.1237323Z 2020-02-07 11:27:50,005 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Connecting to ResourceManager akka.tcp://flink@localhost:6123/user/resourcemanager(00000000000000000000000000000000).
2020-02-07T11:38:27.1237688Z 2020-02-07 11:27:50,238 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Resolved ResourceManager address, beginning registration
2020-02-07T11:38:27.1238037Z 2020-02-07 11:27:50,238 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Registration at ResourceManager attempt 1 (timeout=100ms)
2020-02-07T11:38:27.1238477Z 2020-02-07 11:27:50,311 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Successful registration at resource manager akka.tcp://flink@localhost:6123/user/resourcemanager under registration id f7a1ba44bea1da9aa3e2db07f7510183.
2020-02-07T11:38:27.1238686Z Checking for exceptions...
2020-02-07T11:38:27.1238750Z Found exception in log files:
2020-02-07T11:38:27.1239429Z 2020-02-07 11:27:50,918 INFO org.apache.flink.client.cli.CliFrontend - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1239835Z 2020-02-07 11:27:50,919 INFO org.apache.flink.client.cli.CliFrontend - Starting Command Line Client (Version: 1.11-SNAPSHOT, Rev:e682fc5, Date:07.02.2020 @ 10:01:55 UTC)
2020-02-07T11:38:27.1240164Z 2020-02-07 11:27:50,919 INFO org.apache.flink.client.cli.CliFrontend - OS current user: agent1_azpcontainer
2020-02-07T11:38:27.1240522Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - Current Hadoop/Kerberos user: <no hadoop dependency found>
2020-02-07T11:38:27.1240890Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - JVM: OpenJDK 64-Bit Server VM - Private Build - 1.8/25.242-b08
2020-02-07T11:38:27.1241289Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - Maximum heap size: 14281 MiBytes
2020-02-07T11:38:27.1241661Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
2020-02-07T11:38:27.1242090Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - No Hadoop Dependency available
2020-02-07T11:38:27.1242397Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - JVM Options:
2020-02-07T11:38:27.1242902Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - -Dlog.file=/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/log/flink--client-a3cca9d01479.log
2020-02-07T11:38:27.1243347Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - -Dlog4j.configuration=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/log4j-cli.properties
2020-02-07T11:38:27.1243846Z 2020-02-07 11:27:50,920 INFO org.apache.flink.client.cli.CliFrontend - -Dlogback.configurationFile=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/logback.xml
2020-02-07T11:38:27.1244156Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - Program Arguments:
2020-02-07T11:38:27.1244446Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - run
2020-02-07T11:38:27.1244722Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - -p
2020-02-07T11:38:27.1245009Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - 1
2020-02-07T11:38:27.1245397Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/examples/batch/WordCount.jar
2020-02-07T11:38:27.1245694Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - --input
2020-02-07T11:38:27.1245996Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - s3://test-data/words
2020-02-07T11:38:27.1246274Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - --output
2020-02-07T11:38:27.1246647Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - s3://test-data/temp/test_batch_wordcount-81721a95-6958-4fa2-944e-72ae0a8681f4
2020-02-07T11:38:27.1247494Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - Classpath: /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table-blink_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/log4j-1.2.17.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/slf4j-log4j12-1.7.15.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-dist_2.11-1.11-SNAPSHOT.jar:::
2020-02-07T11:38:27.1248064Z 2020-02-07 11:27:50,921 INFO org.apache.flink.client.cli.CliFrontend - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1248423Z 2020-02-07 11:27:50,927 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1248782Z 2020-02-07 11:27:50,927 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1249178Z 2020-02-07 11:27:50,927 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1249541Z 2020-02-07 11:27:50,927 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1249881Z 2020-02-07 11:27:50,927 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1250226Z 2020-02-07 11:27:50,928 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1250689Z 2020-02-07 11:27:50,928 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1251217Z 2020-02-07 11:27:50,929 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1251576Z 2020-02-07 11:27:50,929 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1251914Z 2020-02-07 11:27:50,929 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1252263Z 2020-02-07 11:27:50,930 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1252593Z 2020-02-07 11:27:50,930 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1252957Z 2020-02-07 11:27:50,930 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1253354Z 2020-02-07 11:27:50,930 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1253760Z 2020-02-07 11:27:50,930 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1254117Z 2020-02-07 11:27:50,933 WARN org.apache.flink.client.cli.CliFrontend - Could not load CLI class org.apache.flink.yarn.cli.FlinkYarnSessionCli.
2020-02-07T11:38:27.1254220Z java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException
2020-02-07T11:38:27.1254310Z at java.lang.Class.forName0(Native Method)
2020-02-07T11:38:27.1254387Z at java.lang.Class.forName(Class.java:264)
2020-02-07T11:38:27.1254477Z at org.apache.flink.client.cli.CliFrontend.loadCustomCommandLine(CliFrontend.java:1076)
2020-02-07T11:38:27.1254647Z at org.apache.flink.client.cli.CliFrontend.loadCustomCommandLines(CliFrontend.java:1030)
2020-02-07T11:38:27.1254741Z at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:957)
2020-02-07T11:38:27.1254824Z Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.exceptions.YarnException
2020-02-07T11:38:27.1254932Z at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
2020-02-07T11:38:27.1255005Z at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
2020-02-07T11:38:27.1255095Z at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
2020-02-07T11:38:27.1255168Z at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
2020-02-07T11:38:27.1255244Z ... 5 more
2020-02-07T11:38:27.1255611Z 2020-02-07 11:27:51,045 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2020-02-07T11:38:27.1256010Z 2020-02-07 11:27:51,098 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1256366Z 2020-02-07 11:27:51,112 INFO org.apache.flink.runtime.security.modules.JaasModule - Jaas file will be created as /tmp/jaas-3983648475548474258.conf.
2020-02-07T11:38:27.1256748Z 2020-02-07 11:27:51,115 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1257063Z 2020-02-07 11:27:51,116 INFO org.apache.flink.client.cli.CliFrontend - Running 'run' command.
2020-02-07T11:38:27.1257361Z 2020-02-07 11:27:51,121 INFO org.apache.flink.client.cli.CliFrontend - Building program from JAR file
2020-02-07T11:38:27.1257766Z 2020-02-07 11:27:51,136 INFO org.apache.flink.client.ClientUtils - Starting program (detached: false)
2020-02-07T11:38:27.1258107Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1258453Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1258788Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1259203Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1259564Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1259900Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1260266Z 2020-02-07 11:27:51,169 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1260599Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1260940Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1261358Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1261713Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1262138Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1262484Z 2020-02-07 11:27:51,170 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1262829Z 2020-02-07 11:27:51,171 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1263151Z 2020-02-07 11:27:51,171 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1263501Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1263905Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1264264Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1264605Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1264960Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1265308Z 2020-02-07 11:27:51,176 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1265654Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1266100Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1266426Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1266778Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1267109Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1267456Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1267806Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1268141Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1268470Z 2020-02-07 11:27:51,177 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1268806Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1269208Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1269542Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1269908Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1270328Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1270674Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1271123Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1271465Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1271818Z 2020-02-07 11:27:51,224 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1272158Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1272504Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1272833Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1273181Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1273522Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1274015Z 2020-02-07 11:27:51,225 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1274379Z 2020-02-07 11:27:51,239 INFO org.apache.flink.api.java.ExecutionEnvironment - The job has 0 registered types and 0 default Kryo serializers
2020-02-07T11:38:27.1274840Z 2020-02-07 11:27:51,471 INFO org.apache.commons.beanutils.FluentPropertyBeanIntrospector - Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property.
2020-02-07T11:38:27.1275273Z 2020-02-07 11:27:51,481 WARN org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties
2020-02-07T11:38:27.1275627Z 2020-02-07 11:27:51,542 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - Scheduled Metric snapshot period at 10 second(s).
2020-02-07T11:38:27.1275951Z 2020-02-07 11:27:51,542 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - s3a-file-system metrics system started
2020-02-07T11:38:27.1276468Z 2020-02-07 11:38:08,935 WARN org.apache.flink.api.common.io.DelimitedInputFormat - Could not determine statistics for files '[s3://test-data/words]' due to an io error: doesBucketExist on test-data: com.amazonaws.SdkClientException: Unable to execute HTTP request: minio: Unable to execute HTTP request: minio
2020-02-07T11:38:27.1276857Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1277190Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1277546Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1277974Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1278331Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1278673Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1279063Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1279431Z 2020-02-07 11:38:08,972 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1279766Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1280128Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1280476Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1280806Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1281237Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1281585Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1282003Z 2020-02-07 11:38:08,973 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1282387Z 2020-02-07 11:38:09,054 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2020-02-07T11:38:27.1282734Z 2020-02-07 11:38:24,743 WARN org.apache.flink.util.ExecutorUtils - ExecutorService did not terminate in time. Shutting it down now.
2020-02-07T11:38:27.1283065Z 2020-02-07 11:38:24,746 ERROR org.apache.flink.client.cli.CliFrontend - Error while running the command.
2020-02-07T11:38:27.1283210Z org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: java.util.concurrent.ExecutionException: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
2020-02-07T11:38:27.1283334Z at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:335)
2020-02-07T11:38:27.1283455Z at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
2020-02-07T11:38:27.1283545Z at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:138)
2020-02-07T11:38:27.1283704Z at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:664)
2020-02-07T11:38:27.1283798Z at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:213)
2020-02-07T11:38:27.1283878Z at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:895)
2020-02-07T11:38:27.1283972Z at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:968)
2020-02-07T11:38:27.1284056Z at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
2020-02-07T11:38:27.1284162Z at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:968)
2020-02-07T11:38:27.1284264Z Caused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
2020-02-07T11:38:27.1284461Z at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:199)
2020-02-07T11:38:27.1284547Z at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:952)
2020-02-07T11:38:27.1284650Z at org.apache.flink.client.program.ContextEnvironment.executeAsync(ContextEnvironment.java:84)
2020-02-07T11:38:27.1284736Z at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:53)
2020-02-07T11:38:27.1284838Z at org.apache.flink.examples.java.wordcount.WordCount.main(WordCount.java:93)
2020-02-07T11:38:27.1284914Z at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-02-07T11:38:27.1285014Z at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-02-07T11:38:27.1285104Z at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-02-07T11:38:27.1285202Z at java.lang.reflect.Method.invoke(Method.java:498)
2020-02-07T11:38:27.1285278Z at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:321)
2020-02-07T11:38:27.1285368Z ... 8 more
2020-02-07T11:38:27.1285447Z Caused by: java.util.concurrent.ExecutionException: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
2020-02-07T11:38:27.1285556Z at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
2020-02-07T11:38:27.1285636Z at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
2020-02-07T11:38:27.1285738Z at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:947)
2020-02-07T11:38:27.1285810Z ... 16 more
2020-02-07T11:38:27.1285900Z Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph.
2020-02-07T11:38:27.1286050Z at org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$7(RestClusterClient.java:359)
2020-02-07T11:38:27.1286161Z at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:884)
2020-02-07T11:38:27.1286246Z at java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:866)
2020-02-07T11:38:27.1286348Z at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-02-07T11:38:27.1286430Z at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
2020-02-07T11:38:27.1286531Z at org.apache.flink.runtime.concurrent.FutureUtils.lambda$retryOperationWithDelay$8(FutureUtils.java:274)
2020-02-07T11:38:27.1286629Z at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
2020-02-07T11:38:27.1286715Z at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
2020-02-07T11:38:27.1286821Z at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
2020-02-07T11:38:27.1286908Z at java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:575)
2020-02-07T11:38:27.1287002Z at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:943)
2020-02-07T11:38:27.1287086Z at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:456)
2020-02-07T11:38:27.1287179Z at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
2020-02-07T11:38:27.1287262Z at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
2020-02-07T11:38:27.1287343Z at java.lang.Thread.run(Thread.java:748)
2020-02-07T11:38:27.1287428Z Caused by: org.apache.flink.runtime.rest.util.RestClientException: [Internal server error., <Exception on server side:
2020-02-07T11:38:27.1287924Z akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/dispatcher#-939201095]] after [10000 ms]. Message of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply.
2020-02-07T11:38:27.1288133Z at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-02-07T11:38:27.1288226Z at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-02-07T11:38:27.1288306Z at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:648)
2020-02-07T11:38:27.1288400Z at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205)
2020-02-07T11:38:27.1288495Z at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)
2020-02-07T11:38:27.1288575Z at scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)
2020-02-07T11:38:27.1288669Z at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
2020-02-07T11:38:27.1288754Z at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328)
2020-02-07T11:38:27.1288874Z at akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:279)
2020-02-07T11:38:27.1288978Z at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:283)
2020-02-07T11:38:27.1289122Z at akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:235)
2020-02-07T11:38:27.1289197Z at java.lang.Thread.run(Thread.java:748)
2020-02-07T11:38:27.1289256Z
2020-02-07T11:38:27.1289314Z End of exception on server side>]
2020-02-07T11:38:27.1289385Z at org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:390)
2020-02-07T11:38:27.1289478Z at org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:374)
2020-02-07T11:38:27.1289559Z at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:966)
2020-02-07T11:38:27.1289659Z at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940)
2020-02-07T11:38:27.1289812Z ... 4 more
2020-02-07T11:38:27.1290157Z 2020-02-07 11:27:47,895 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1290583Z 2020-02-07 11:27:47,897 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneSessionClusterEntrypoint (Version: 1.11-SNAPSHOT, Rev:e682fc5, Date:07.02.2020 @ 10:01:55 UTC)
2020-02-07T11:38:27.1290913Z 2020-02-07 11:27:47,897 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - OS current user: agent1_azpcontainer
2020-02-07T11:38:27.1291344Z 2020-02-07 11:27:47,898 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Current Hadoop/Kerberos user: <no hadoop dependency found>
2020-02-07T11:38:27.1291688Z 2020-02-07 11:27:47,898 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM: OpenJDK 64-Bit Server VM - Private Build - 1.8/25.242-b08
2020-02-07T11:38:27.1292024Z 2020-02-07 11:27:47,898 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Maximum heap size: 981 MiBytes
2020-02-07T11:38:27.1292346Z 2020-02-07 11:27:47,898 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
2020-02-07T11:38:27.1292671Z 2020-02-07 11:27:47,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - No Hadoop Dependency available
2020-02-07T11:38:27.1292965Z 2020-02-07 11:27:47,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM Options:
2020-02-07T11:38:27.1293245Z 2020-02-07 11:27:47,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xms1024m
2020-02-07T11:38:27.1293538Z 2020-02-07 11:27:47,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xmx1024m
2020-02-07T11:38:27.1294004Z 2020-02-07 11:27:47,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlog.file=/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/log/flink--standalonesession-0-a3cca9d01479.log
2020-02-07T11:38:27.1294541Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlog4j.configuration=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/log4j.properties
2020-02-07T11:38:27.1294972Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlogback.configurationFile=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/logback.xml
2020-02-07T11:38:27.1295285Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Program Arguments:
2020-02-07T11:38:27.1295590Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --configDir
2020-02-07T11:38:27.1295935Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf
2020-02-07T11:38:27.1296260Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --executionMode
2020-02-07T11:38:27.1296562Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - cluster
2020-02-07T11:38:27.1297383Z 2020-02-07 11:27:47,900 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Classpath: /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table-blink_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/log4j-1.2.17.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/slf4j-log4j12-1.7.15.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-dist_2.11-1.11-SNAPSHOT.jar:::
2020-02-07T11:38:27.1297969Z 2020-02-07 11:27:47,901 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1298326Z 2020-02-07 11:27:47,902 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Registered UNIX signal handlers for [TERM, HUP, INT]
2020-02-07T11:38:27.1298663Z 2020-02-07 11:27:47,921 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1299047Z 2020-02-07 11:27:47,921 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1299412Z 2020-02-07 11:27:47,922 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1299756Z 2020-02-07 11:27:47,922 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1300125Z 2020-02-07 11:27:47,922 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1300459Z 2020-02-07 11:27:47,922 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1300819Z 2020-02-07 11:27:47,923 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1301229Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1301572Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1301925Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1302351Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1302697Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1303027Z 2020-02-07 11:27:47,924 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1303372Z 2020-02-07 11:27:47,925 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1303759Z 2020-02-07 11:27:47,925 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1304105Z 2020-02-07 11:27:47,997 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneSessionClusterEntrypoint.
2020-02-07T11:38:27.1304427Z 2020-02-07 11:27:47,997 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install default filesystem.
2020-02-07T11:38:27.1304808Z 2020-02-07 11:27:48,042 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2020-02-07T11:38:27.1305139Z 2020-02-07 11:27:48,070 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install security context.
2020-02-07T11:38:27.1305495Z 2020-02-07 11:27:48,078 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1305954Z 2020-02-07 11:27:48,083 INFO org.apache.flink.runtime.security.modules.JaasModule - Jaas file will be created as /tmp/jaas-1463730351068169936.conf.
2020-02-07T11:38:27.1306337Z 2020-02-07 11:27:48,085 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1306647Z 2020-02-07 11:27:48,086 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Initializing cluster services.
2020-02-07T11:38:27.1306977Z 2020-02-07 11:27:48,110 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at localhost:6123
2020-02-07T11:38:27.1307271Z 2020-02-07 11:27:48,558 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2020-02-07T11:38:27.1307569Z 2020-02-07 11:27:48,579 INFO akka.remote.Remoting - Starting remoting
2020-02-07T11:38:27.1307908Z 2020-02-07 11:27:48,686 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://flink@localhost:6123]
2020-02-07T11:38:27.1308276Z 2020-02-07 11:27:48,743 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://flink@localhost:6123
2020-02-07T11:38:27.1308639Z 2020-02-07 11:27:48,833 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2020-02-07T11:38:27.1309093Z 2020-02-07 11:27:48,840 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /tmp/blobStore-15b15eb1-9d1b-4668-9bc4-136ca053014f
2020-02-07T11:38:27.1309488Z 2020-02-07 11:27:48,843 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:41085 - max concurrent requests: 50 - max backlog: 1000
2020-02-07T11:38:27.1309837Z 2020-02-07 11:27:48,852 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No metrics reporter configured, no metrics will be exposed/reported.
2020-02-07T11:38:27.1310267Z 2020-02-07 11:27:48,855 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at localhost:0
2020-02-07T11:38:27.1310563Z 2020-02-07 11:27:48,871 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2020-02-07T11:38:27.1310865Z 2020-02-07 11:27:48,873 INFO akka.remote.Remoting - Starting remoting
2020-02-07T11:38:27.1311295Z 2020-02-07 11:27:48,881 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://flink-metrics@localhost:38313]
2020-02-07T11:38:27.1311656Z 2020-02-07 11:27:48,887 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://flink-metrics@localhost:38313
2020-02-07T11:38:27.1312081Z 2020-02-07 11:27:48,892 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/MetricQueryService .
2020-02-07T11:38:27.1312585Z 2020-02-07 11:27:48,953 INFO org.apache.flink.runtime.dispatcher.FileArchivedExecutionGraphStore - Initializing FileArchivedExecutionGraphStore: Storage directory /tmp/executionGraphStore-157dd226-fdb1-4436-9270-f3dd8408151a, expiration time 3600000, maximum cache size 52428800 bytes.
2020-02-07T11:38:27.1312995Z 2020-02-07 11:27:48,989 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2020-02-07T11:38:27.1313376Z 2020-02-07 11:27:48,989 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'rest.port' instead of key 'rest.bind-port'
2020-02-07T11:38:27.1313820Z 2020-02-07 11:27:48,990 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Upload directory /tmp/flink-web-1b994d2a-a9d0-4687-b2d9-5b8b605b23d6/flink-web-upload does not exist.
2020-02-07T11:38:27.1314332Z 2020-02-07 11:27:48,990 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Created directory /tmp/flink-web-1b994d2a-a9d0-4687-b2d9-5b8b605b23d6/flink-web-upload for file uploads.
2020-02-07T11:38:27.1314642Z 2020-02-07 11:27:48,991 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Starting rest endpoint.
2020-02-07T11:38:27.1315107Z 2020-02-07 11:27:49,166 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils - Determined location of main cluster component log file: /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/log/flink--standalonesession-0-a3cca9d01479.log
2020-02-07T11:38:27.1315608Z 2020-02-07 11:27:49,166 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils - Determined location of main cluster component stdout file: /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/log/flink--standalonesession-0-a3cca9d01479.out
2020-02-07T11:38:27.1315957Z 2020-02-07 11:27:49,309 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Rest endpoint listening at localhost:8081
2020-02-07T11:38:27.1316360Z 2020-02-07 11:27:49,310 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - http://localhost:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
2020-02-07T11:38:27.1316691Z 2020-02-07 11:27:49,310 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Web frontend listening at http://localhost:8081.
2020-02-07T11:38:27.1317106Z 2020-02-07 11:27:49,320 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/resourcemanager .
2020-02-07T11:38:27.1317458Z 2020-02-07 11:27:49,340 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess - Start SessionDispatcherLeaderProcess.
2020-02-07T11:38:27.1317785Z 2020-02-07 11:27:49,342 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess - Recover all persisted job graphs.
2020-02-07T11:38:27.1318218Z 2020-02-07 11:27:49,342 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess - Successfully recovered 0 persisted job graphs.
2020-02-07T11:38:27.1318643Z 2020-02-07 11:27:49,345 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - ResourceManager akka.tcp://flink@localhost:6123/user/resourcemanager was granted leadership with fencing token 00000000000000000000000000000000
2020-02-07T11:38:27.1319109Z 2020-02-07 11:27:49,347 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/dispatcher .
2020-02-07T11:38:27.1319449Z 2020-02-07 11:27:49,349 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Starting the SlotManager.
2020-02-07T11:38:27.1319893Z 2020-02-07 11:27:50,299 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Registering TaskManager with ResourceID 7722ce213a196a9126c849ff4f6b42cd (akka.tcp://[email protected]:44825/user/taskmanager_0) at ResourceManager
2020-02-07T11:38:27.1320305Z 2020-02-07 11:38:09,650 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Received JobGraph submission 34ffd3de4a8b9a7d4ef8ac924e913d66 (WordCount Example).
2020-02-07T11:38:27.1320661Z 2020-02-07 11:38:09,650 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Submitting job 34ffd3de4a8b9a7d4ef8ac924e913d66 (WordCount Example).
2020-02-07T11:38:27.1321130Z 2020-02-07 11:38:09,667 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/jobmanager_0 .
2020-02-07T11:38:27.1321593Z 2020-02-07 11:38:09,673 INFO org.apache.flink.runtime.jobmaster.JobMaster - Initializing job WordCount Example (34ffd3de4a8b9a7d4ef8ac924e913d66).
2020-02-07T11:38:27.1322027Z 2020-02-07 11:38:09,690 INFO org.apache.flink.runtime.jobmaster.JobMaster - Using restart back off time strategy NoRestartBackoffTimeStrategy for WordCount Example (34ffd3de4a8b9a7d4ef8ac924e913d66).
2020-02-07T11:38:27.1322428Z 2020-02-07 11:38:09,718 INFO org.apache.flink.runtime.jobmaster.JobMaster - Running initialization on master for job WordCount Example (34ffd3de4a8b9a7d4ef8ac924e913d66).
2020-02-07T11:38:27.1322774Z 2020-02-07 11:38:09,730 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1323122Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1323461Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1323885Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1324243Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1324570Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1324932Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1325269Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1325622Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1326047Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1326395Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1326727Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1327074Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1327413Z 2020-02-07 11:38:09,731 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1327749Z 2020-02-07 11:38:09,732 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1328099Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1328429Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1328777Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1329167Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1329605Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1329956Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1330304Z 2020-02-07 11:38:09,748 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1330651Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1331048Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1331410Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1331750Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1332107Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1332439Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1332783Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1333115Z 2020-02-07 11:38:09,749 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1333635Z 2020-02-07 11:38:09,952 INFO org.apache.commons.beanutils.FluentPropertyBeanIntrospector - Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property.
2020-02-07T11:38:27.1334166Z 2020-02-07 11:38:09,962 WARN org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties
2020-02-07T11:38:27.1334498Z 2020-02-07 11:38:09,982 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - Scheduled Metric snapshot period at 10 second(s).
2020-02-07T11:38:27.1334825Z 2020-02-07 11:38:09,982 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - s3a-file-system metrics system started
2020-02-07T11:38:27.1335211Z 2020-02-07 11:38:10,004 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2020-02-07T11:38:27.1335528Z 2020-02-07 11:38:19,669 ERROR org.apache.flink.runtime.rest.handler.job.JobSubmitHandler - Unhandled exception.
2020-02-07T11:38:27.1336000Z akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/dispatcher#-939201095]] after [10000 ms]. Message of type [org.apache.flink.runtime.rpc.messages.LocalFencedMessage]. A typical reason for `AskTimeoutException` is that the recipient actor didn't send a reply.
2020-02-07T11:38:27.1336131Z at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-02-07T11:38:27.1336227Z at akka.pattern.PromiseActorRef$$anonfun$2.apply(AskSupport.scala:635)
2020-02-07T11:38:27.1336304Z at akka.pattern.PromiseActorRef$$anonfun$1.apply$mcV$sp(AskSupport.scala:648)
2020-02-07T11:38:27.1336400Z at akka.actor.Scheduler$$anon$4.run(Scheduler.scala:205)
2020-02-07T11:38:27.1336475Z at scala.concurrent.Future$InternalCallbackExecutor$.unbatchedExecute(Future.scala:601)
2020-02-07T11:38:27.1336645Z at scala.concurrent.BatchingExecutor$class.execute(BatchingExecutor.scala:109)
2020-02-07T11:38:27.1336732Z at scala.concurrent.Future$InternalCallbackExecutor$.execute(Future.scala:599)
2020-02-07T11:38:27.1336832Z at akka.actor.LightArrayRevolverScheduler$TaskHolder.executeTask(LightArrayRevolverScheduler.scala:328)
2020-02-07T11:38:27.1336925Z at akka.actor.LightArrayRevolverScheduler$$anon$4.executeBucket$1(LightArrayRevolverScheduler.scala:279)
2020-02-07T11:38:27.1337034Z at akka.actor.LightArrayRevolverScheduler$$anon$4.nextTick(LightArrayRevolverScheduler.scala:283)
2020-02-07T11:38:27.1337121Z at akka.actor.LightArrayRevolverScheduler$$anon$4.run(LightArrayRevolverScheduler.scala:235)
2020-02-07T11:38:27.1337211Z at java.lang.Thread.run(Thread.java:748)
2020-02-07T11:38:27.1337548Z 2020-02-07 11:27:48,619 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1337874Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Preconfiguration:
2020-02-07T11:38:27.1338168Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner -
2020-02-07T11:38:27.1338224Z
2020-02-07T11:38:27.1338258Z
2020-02-07T11:38:27.1338333Z TM_RESOURCES_JVM_PARAMS extraction logs:
2020-02-07T11:38:27.1338556Z - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1338794Z - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1339052Z - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1339321Z - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1339551Z - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1339790Z - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1340030Z - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1340278Z - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1340579Z - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1340820Z - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1341124Z - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1341365Z - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1341587Z - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1341823Z - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1342039Z - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1342384Z - The derived from fraction jvm overhead memory (156.800mb (164416719 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead
2020-02-07T11:38:27.1342696Z BASH_JAVA_UTILS_EXEC_RESULT:-Xmx536870902 -Xms536870902 -XX:MaxDirectMemorySize=268435458 -XX:MaxMetaspaceSize=100663296
2020-02-07T11:38:27.1342765Z
2020-02-07T11:38:27.1342843Z TM_RESOURCES_DYNAMIC_CONFIGS extraction logs:
2020-02-07T11:38:27.1343070Z - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1343309Z - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1343532Z - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1343863Z - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1344093Z - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1344331Z - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1344567Z - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1344810Z - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1345027Z - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1345355Z - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1345582Z - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1345830Z - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1346054Z - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1346290Z - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1346501Z - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1346842Z - The derived from fraction jvm overhead memory (156.800mb (164416719 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead
2020-02-07T11:38:27.1347427Z BASH_JAVA_UTILS_EXEC_RESULT:-D taskmanager.memory.framework.off-heap.size=134217728b -D taskmanager.memory.network.max=134217730b -D taskmanager.memory.network.min=134217730b -D taskmanager.memory.framework.heap.size=134217728b -D taskmanager.memory.managed.size=536870920b -D taskmanager.cpu.cores=1.0 -D taskmanager.memory.task.heap.size=402653174b -D taskmanager.memory.task.off-heap.size=0b
2020-02-07T11:38:27.1347582Z
2020-02-07T11:38:27.1347922Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1348303Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Starting TaskManager (Version: 1.11-SNAPSHOT, Rev:e682fc5, Date:07.02.2020 @ 10:01:55 UTC)
2020-02-07T11:38:27.1348643Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - OS current user: agent1_azpcontainer
2020-02-07T11:38:27.1348975Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Current Hadoop/Kerberos user: <no hadoop dependency found>
2020-02-07T11:38:27.1349379Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - JVM: OpenJDK 64-Bit Server VM - Private Build - 1.8/25.242-b08
2020-02-07T11:38:27.1349717Z 2020-02-07 11:27:48,620 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Maximum heap size: 512 MiBytes
2020-02-07T11:38:27.1350118Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
2020-02-07T11:38:27.1350435Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - No Hadoop Dependency available
2020-02-07T11:38:27.1350720Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - JVM Options:
2020-02-07T11:38:27.1351092Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -XX:+UseG1GC
2020-02-07T11:38:27.1351387Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -Xmx536870902
2020-02-07T11:38:27.1351698Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -Xms536870902
2020-02-07T11:38:27.1352024Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -XX:MaxDirectMemorySize=268435458
2020-02-07T11:38:27.1352330Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -XX:MaxMetaspaceSize=100663296
2020-02-07T11:38:27.1382581Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -Dlog.file=/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/log/flink--taskexecutor-0-a3cca9d01479.log
2020-02-07T11:38:27.1383457Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -Dlog4j.configuration=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/log4j.properties
2020-02-07T11:38:27.1384028Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -Dlogback.configurationFile=file:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf/logback.xml
2020-02-07T11:38:27.1384623Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Program Arguments:
2020-02-07T11:38:27.1384906Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - --configDir
2020-02-07T11:38:27.1385275Z 2020-02-07 11:27:48,621 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/conf
2020-02-07T11:38:27.1385580Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1385906Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.framework.off-heap.size=134217728b
2020-02-07T11:38:27.1386206Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1386524Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.network.max=134217730b
2020-02-07T11:38:27.1386832Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1387140Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.network.min=134217730b
2020-02-07T11:38:27.1387434Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1387747Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.framework.heap.size=134217728b
2020-02-07T11:38:27.1388044Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1388352Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.managed.size=536870920b
2020-02-07T11:38:27.1388657Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1389118Z 2020-02-07 11:27:48,622 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.cpu.cores=1.0
2020-02-07T11:38:27.1389401Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1389729Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.task.heap.size=402653174b
2020-02-07T11:38:27.1390006Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - -D
2020-02-07T11:38:27.1390328Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - taskmanager.memory.task.off-heap.size=0b
2020-02-07T11:38:27.1391264Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Classpath: /__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-table-blink_2.11-1.11-SNAPSHOT.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/log4j-1.2.17.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/slf4j-log4j12-1.7.15.jar:/__w/1/s/flink-dist/target/flink-1.11-SNAPSHOT-bin/flink-1.11-SNAPSHOT/lib/flink-dist_2.11-1.11-SNAPSHOT.jar:::
2020-02-07T11:38:27.1391759Z 2020-02-07 11:27:48,623 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - --------------------------------------------------------------------------------
2020-02-07T11:38:27.1392108Z 2020-02-07 11:27:48,624 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Registered UNIX signal handlers for [TERM, HUP, INT]
2020-02-07T11:38:27.1392542Z 2020-02-07 11:27:48,628 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Maximum number of open file descriptors is 1048576.
2020-02-07T11:38:27.1392888Z 2020-02-07 11:27:48,641 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, localhost
2020-02-07T11:38:27.1393235Z 2020-02-07 11:27:48,641 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2020-02-07T11:38:27.1393628Z 2020-02-07 11:27:48,642 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2020-02-07T11:38:27.1393994Z 2020-02-07 11:27:48,642 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.memory.process.size, 1568m
2020-02-07T11:38:27.1394331Z 2020-02-07 11:27:48,642 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2020-02-07T11:38:27.1394685Z 2020-02-07 11:27:48,642 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2020-02-07T11:38:27.1395036Z 2020-02-07 11:27:48,642 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2020-02-07T11:38:27.1395385Z 2020-02-07 11:27:48,643 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.access-key, access_key
2020-02-07T11:38:27.1395726Z 2020-02-07 11:27:48,643 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.secret-key, ******
2020-02-07T11:38:27.1396057Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.endpoint, http://minio:9000
2020-02-07T11:38:27.1396410Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path.style.access, true
2020-02-07T11:38:27.1396825Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.path-style-access, true
2020-02-07T11:38:27.1397181Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: s3.connection.timeout, 5000
2020-02-07T11:38:27.1397504Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: akka.ask.timeout, 300 s
2020-02-07T11:38:27.1397838Z 2020-02-07 11:27:48,644 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: rest.port, 8081
2020-02-07T11:38:27.1398242Z 2020-02-07 11:27:48,746 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2020-02-07T11:38:27.1398623Z 2020-02-07 11:27:48,790 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1399010Z 2020-02-07 11:27:48,804 INFO org.apache.flink.runtime.security.modules.JaasModule - Jaas file will be created as /tmp/jaas-1199271464048060563.conf.
2020-02-07T11:38:27.1399403Z 2020-02-07 11:27:48,807 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2020-02-07T11:38:27.1399792Z 2020-02-07 11:27:48,863 INFO org.apache.flink.configuration.Configuration - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2020-02-07T11:38:27.1400192Z 2020-02-07 11:27:48,872 INFO org.apache.flink.runtime.util.LeaderRetrievalUtils - Trying to select the network interface and address to use by connecting to the leading JobManager.
2020-02-07T11:38:27.1400637Z 2020-02-07 11:27:48,872 INFO org.apache.flink.runtime.util.LeaderRetrievalUtils - TaskManager will try to connect for PT10S before falling back to heuristics
2020-02-07T11:38:27.1401076Z 2020-02-07 11:27:48,950 INFO org.apache.flink.runtime.net.ConnectionUtils - Retrieved new target address localhost/127.0.0.1:6123.
2020-02-07T11:38:27.1401469Z 2020-02-07 11:27:48,955 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - TaskManager will use hostname/address 'a3cca9d01479' (192.168.64.2) for communication.
2020-02-07T11:38:27.1401797Z 2020-02-07 11:27:48,963 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at 192.168.64.2:0
2020-02-07T11:38:27.1402109Z 2020-02-07 11:27:49,351 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2020-02-07T11:38:27.1402398Z 2020-02-07 11:27:49,373 INFO akka.remote.Remoting - Starting remoting
2020-02-07T11:38:27.1402767Z 2020-02-07 11:27:49,493 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://[email protected]:44825]
2020-02-07T11:38:27.1403104Z 2020-02-07 11:27:49,576 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://[email protected]:44825
2020-02-07T11:38:27.1403461Z 2020-02-07 11:27:49,589 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No metrics reporter configured, no metrics will be exposed/reported.
2020-02-07T11:38:27.1403846Z 2020-02-07 11:27:49,592 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at 192.168.64.2:0
2020-02-07T11:38:27.1404156Z 2020-02-07 11:27:49,608 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2020-02-07T11:38:27.1404471Z 2020-02-07 11:27:49,611 INFO akka.remote.Remoting - Starting remoting
2020-02-07T11:38:27.1404919Z 2020-02-07 11:27:49,619 INFO akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://[email protected]:45750]
2020-02-07T11:38:27.1405286Z 2020-02-07 11:27:49,628 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Actor system started at akka.tcp://[email protected]:45750
2020-02-07T11:38:27.1405728Z 2020-02-07 11:27:49,633 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/MetricQueryService_7722ce213a196a9126c849ff4f6b42cd .
2020-02-07T11:38:27.1406141Z 2020-02-07 11:27:49,648 INFO org.apache.flink.runtime.blob.PermanentBlobCache - Created BLOB cache storage directory /tmp/blobStore-fab5a5b4-4fb2-40ef-98de-cead95d128c7
2020-02-07T11:38:27.1406538Z 2020-02-07 11:27:49,651 INFO org.apache.flink.runtime.blob.TransientBlobCache - Created BLOB cache storage directory /tmp/blobStore-137d52c7-b288-48f5-87dc-bc327caf599f
2020-02-07T11:38:27.1406901Z 2020-02-07 11:27:49,651 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner - Starting TaskManager with ResourceID: 7722ce213a196a9126c849ff4f6b42cd
2020-02-07T11:38:27.1407274Z 2020-02-07 11:27:49,709 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices - Temporary file directory '/tmp': total 125 GB, usable 77 GB (61.60% usable)
2020-02-07T11:38:27.1407655Z 2020-02-07 11:27:49,712 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager uses directory /tmp/flink-io-9bf5d7ea-9a0d-46c2-bfbe-20de9f382f6b for spill files.
2020-02-07T11:38:27.1408317Z 2020-02-07 11:27:49,720 INFO org.apache.flink.runtime.io.network.netty.NettyConfig - NettyConfig [server address: /192.168.64.2, server port: 0, ssl enabled: false, memory segment size (bytes): 32768, transport type: AUTO, number of server threads: 1 (manual), number of client threads: 1 (manual), server connect backlog: 0 (use Netty's default), client connect timeout (sec): 120, send/receive buffer size (bytes): 0 (use Netty's default)]
2020-02-07T11:38:27.1408891Z 2020-02-07 11:27:49,722 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager uses directory /tmp/flink-netty-shuffle-8ef69a51-79bb-431e-80f6-c4209d6e6bf5 for spill files.
2020-02-07T11:38:27.1409340Z 2020-02-07 11:27:49,879 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated 128 MB for network buffer pool (number of memory segments: 4096, bytes per segment: 32768).
2020-02-07T11:38:27.1409676Z 2020-02-07 11:27:49,886 INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Starting the network environment and its components.
2020-02-07T11:38:27.1410001Z 2020-02-07 11:27:49,939 INFO org.apache.flink.runtime.io.network.netty.NettyClient - Transport type 'auto': using EPOLL.
2020-02-07T11:38:27.1410316Z 2020-02-07 11:27:49,941 INFO org.apache.flink.runtime.io.network.netty.NettyClient - Successful initialization (took 54 ms).
2020-02-07T11:38:27.1410645Z 2020-02-07 11:27:49,945 INFO org.apache.flink.runtime.io.network.netty.NettyServer - Transport type 'auto': using EPOLL.
2020-02-07T11:38:27.1411103Z 2020-02-07 11:27:49,975 INFO org.apache.flink.runtime.io.network.netty.NettyServer - Successful initialization (took 33 ms). Listening on SocketAddress /192.168.64.2:34742.
2020-02-07T11:38:27.1411438Z 2020-02-07 11:27:49,976 INFO org.apache.flink.runtime.taskexecutor.KvStateService - Starting the kvState service and its components.
2020-02-07T11:38:27.1411774Z 2020-02-07 11:27:49,984 INFO org.apache.flink.runtime.taskexecutor.TaskManagerConfiguration - Messages have a max timeout of 300000 ms
2020-02-07T11:38:27.1412152Z 2020-02-07 11:27:49,992 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/taskmanager_0 .
2020-02-07T11:38:27.1412584Z 2020-02-07 11:27:50,002 INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Start job leader service.
2020-02-07T11:38:27.1412947Z 2020-02-07 11:27:50,003 INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory /tmp/flink-dist-cache-f0574260-6be5-4a14-812e-ee00c8c44171
2020-02-07T11:38:27.1413365Z 2020-02-07 11:27:50,005 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Connecting to ResourceManager akka.tcp://flink@localhost:6123/user/resourcemanager(00000000000000000000000000000000).
2020-02-07T11:38:27.1413817Z 2020-02-07 11:27:50,238 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Resolved ResourceManager address, beginning registration
2020-02-07T11:38:27.1414150Z 2020-02-07 11:27:50,238 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Registration at ResourceManager attempt 1 (timeout=100ms)
2020-02-07T11:38:27.1414604Z 2020-02-07 11:27:50,311 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Successful registration at resource manager akka.tcp://flink@localhost:6123/user/resourcemanager under registration id f7a1ba44bea1da9aa3e2db07f7510183.
2020-02-07T11:38:27.1414865Z Checking for non-empty .out files...
2020-02-07T11:38:27.1415051Z No non-empty .out files.
2020-02-07T11:38:27.1415097Z
2020-02-07T11:38:27.1415444Z [FAIL] 'Shaded Hadoop S3A end-to-end test (minio)' failed after 10 minutes and 45 seconds! Test exited with exit code 1 and the logs contained errors, exceptions or non-empty .out files
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment