Created
October 19, 2017 04:18
-
-
Save reizist/b1a07d6326c48b5ecfaa9aec62182188 to your computer and use it in GitHub Desktop.
difference of presto launching log between local and emr
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /local.txt | |
| +++ b/emr.txt | |
| -INFO main Bootstrap PROPERTY DEFAULT RUNTIME DESCRIPTION | |
| +INFO main Bootstrap PROPERTY DEFAULT RUNTIME DESCRIPTION | |
| -INFO main Bootstrap query-manager.initialization-required-workers 1 1 Minimum number of workers that must be available before the cluster will accept queries | |
| -INFO main Bootstrap query-manager.initialization-timeout 5.00m 5.00m After this time, the cluster will accept queries even if the minimum required workers are not available | |
| -INFO main Bootstrap query.max-history 100 100 | |
| +INFO main Bootstrap query.max-history 100 40 | |
| -INFO main Bootstrap query.min-expire-age 15.00m 15.00m | |
| +INFO main Bootstrap query.min-expire-age 15.00m 30.00m | |
| -INFO main Bootstrap query.queue-config-file null null | |
| +INFO main Bootstrap query.queue-config-file null /home/hadoop/emr_configs/queue.json | |
| -INFO main Bootstrap task.info-update-interval 3.00s 3.00s Interval between updating task data | |
| -INFO main Bootstrap task.initial-splits-per-node 16 16 | |
| -INFO main Bootstrap task.legacy-scheduling-behavior true true | |
| -INFO main Bootstrap task.level-absolute-priority true true | |
| -INFO main Bootstrap task.level-time-multiplier 2 2 Factor that determines the target scheduled time for a level relative to the next | |
| +INFO main Bootstrap task.info-update-interval 3.00s 3.00s Interval between updating task data | |
| +INFO main Bootstrap task.initial-splits-per-node 8 8 | |
| -INFO main Bootstrap task.max-worker-threads 16 16 | |
| -INFO main Bootstrap task.min-drivers 32 32 | |
| +INFO main Bootstrap task.max-worker-threads 8 8 | |
| +INFO main Bootstrap task.min-drivers 16 16 | |
| -INFO main Bootstrap sink.max-buffer-size 32MB 32MB | |
| +INFO main Bootstrap sink.max-buffer-size 32MB 1GB | |
| -INFO main Bootstrap task.concurrency 16 16 Default number of local parallel jobs per worker | |
| +INFO main Bootstrap task.concurrency 16 16 Default number of local parallel jobs per worker | |
| -INFO main Bootstrap task.task-notification-threads 5 5 Number of threads used for internal task event notifications | |
| -INFO main Bootstrap task.task-yield-threads 3 3 Number of threads used for setting yield signals | |
| +INFO main Bootstrap task.task-notification-threads 5 5 Number of threads used for internal task event notifications | |
| -INFO main Bootstrap task.writer-count 1 1 Number of writers per task | |
| -INFO main Bootstrap node-scheduler.include-coordinator true true | |
| +INFO main Bootstrap task.writer-count 1 1 Number of writers per task | |
| +INFO main Bootstrap node-scheduler.include-coordinator true false | |
| -INFO main Bootstrap failure-detector.expiration-grace-interval 10.00m 10.00m How long to wait before 'forgetting' a service after it disappears from discovery | |
| +INFO main Bootstrap failure-detector.expiration-grace-interval 10.00m 10.00m How long to wait before 'forgetting' a service after it disappears from discovery | |
| -INFO main Bootstrap failure-detector.warmup-interval 5.00s 5.00s How long to wait after transitioning to success before considering a service alive | |
| -INFO main Bootstrap query.low-memory-killer.enabled false false Enable low memory killer | |
| -INFO main Bootstrap query.low-memory-killer.delay 5.00m 5.00m Delay between cluster running low on memory and invoking killer | |
| -INFO main Bootstrap query.max-memory 20GB 5GB | |
| -INFO main Bootstrap query.max-memory-per-node 1717986918.40B 1GB | |
| -INFO main Bootstrap resources.reserved-system-memory 6871947673.60B 6871947673.60B | |
| -INFO main Bootstrap catalog.config-dir etc/catalog etc/catalog | |
| +INFO main Bootstrap failure-detector.warmup-interval 5.00s 5.00s How long to wait after transitioning to success before considering a service alive | |
| +INFO main Bootstrap query.low-memory-killer.enabled false false Enable low memory killer | |
| +INFO main Bootstrap query.low-memory-killer.delay 5.00m 5.00m Delay between cluster running low on memory and invoking killer | |
| +INFO main Bootstrap query.max-memory 20GB 100GB | |
| +INFO main Bootstrap query.max-memory-per-node 2567418675.20B 12863427052B | |
| +INFO main Bootstrap resources.reserved-system-memory 10269674700.80B 10269674700.80B | |
| +INFO main Bootstrap catalog.config-dir etc/catalog /etc/presto/conf/catalog | |
| -INFO main Bootstrap code-cache-check-interval 20.00s 20.00s How often to check if the code cache need to be collected | |
| -INFO main Bootstrap code-cache-collection-threshold 40 40 Maximum code cache usage (percentage) before attempting to force a collection | |
| +INFO main Bootstrap code-cache-check-interval 20.00s 20.00s How often to check if the code cache need to be collected | |
| +INFO main Bootstrap code-cache-collection-threshold 40 40 Maximum code cache usage (percentage) before attempting to force a collection | |
| -INFO main Bootstrap plugin.dir plugin plugin | |
| -INFO main Bootstrap maven.repo.local /Users/reizist/.m2/repository /Users/reizist/.m2/repository | |
| +INFO main Bootstrap internal-communication.authentication.ldap.password null null | |
| +INFO main Bootstrap internal-communication.authentication.ldap.user null null | |
| +INFO main Bootstrap plugin.dir plugin /usr/lib/presto/plugin | |
| +INFO main Bootstrap maven.repo.local /var/lib/presto/.m2/repository /var/lib/presto/.m2/repository | |
| -INFO main Bootstrap http-server.authentication.type NONE NONE Authentication type (supported types: NONE, KERBEROS, LDAP) | |
| -INFO main Bootstrap experimental.max-spill-per-node 100GB 100GB | |
| -INFO main Bootstrap experimental.query-max-spill-per-node 100GB 100GB | |
| -INFO main Bootstrap experimental.aggregation-operator-unspill-memory-limit 4MB 4MB | |
| -INFO main Bootstrap colocated-joins-enabled false false Experimental: Use a colocated join when possible | |
| +INFO main Bootstrap http-server.authentication.type NONE NONE Authentication type (supported types: NONE, KERBEROS, LDAP) | |
| +INFO main Bootstrap colocated-joins-enabled false false Experimental: Use a colocated join when possible | |
| -INFO main Bootstrap optimizer.enable-intermediate-aggregations false false | |
| -INFO main Bootstrap fast-inequality-joins true true Use faster handling of inequality joins if it is possible | |
| -INFO main Bootstrap optimizer.force-single-node-output false false | |
| -INFO main Bootstrap experimental.iterative-optimizer-enabled true true | |
| +INFO main Bootstrap experimental.iterative-optimizer-enabled false false | |
| -INFO main Bootstrap reorder-joins true true Experimental: Reorder joins to optimize plan | |
| +INFO main Bootstrap reorder-joins false false Experimental: Reorder joins to optimize plan | |
| -INFO main Bootstrap experimental.memory-revoking-target 0.5 0.5 When revoking memory, try to revoke so much that pool is filled below target at the end | |
| -INFO main Bootstrap experimental.memory-revoking-threshold 0.9 0.9 Revoke memory when memory pool is filled over threshold | |
| +INFO main Bootstrap experimental.operator-memory-limit-before-spill 4MB 4MB | |
| -INFO main Bootstrap optimizer.push-aggregation-through-join true true | |
| +INFO main Bootstrap optimizer.processing-optimization disabled disabled | |
| +INFO main Bootstrap optimizer.reorder-windows false false | |
| -INFO main Bootstrap experimental.spiller-max-used-space-threshold 0.9 0.9 | |
| -INFO main Bootstrap experimental.spiller-spill-path [] [] | |
| +INFO main Bootstrap experimental.spiller-spill-path /tmp/presto/spills /tmp/presto/spills | |
| -INFO main Bootstrap compiler.expression-cache-size 10000 10000 | |
| -INFO main Bootstrap transaction.idle-check-interval 1.00m 1.00m Time interval between idle transactions checks | |
| -INFO main Bootstrap transaction.idle-timeout 5.00m 5.00m Amount of time before an inactive transaction is considered expired | |
| -INFO main Bootstrap transaction.max-finishing-concurrency 1 1 Maximum parallelism for committing or aborting a transaction | |
| -INFO main Bootstrap discovery.uri null http://localhost:8080 Discovery service base URI | |
| -INFO main Bootstrap service-inventory.uri null null Service inventory base URI | |
| -INFO main Bootstrap service-inventory.update-interval 10.00s 10.00s Service inventory update interval | |
| +INFO main Bootstrap transaction.idle-check-interval 1.00m 1.00m Time interval between idle transactions checks | |
| +INFO main Bootstrap transaction.idle-timeout 5.00m 5.00m Amount of time before an inactive transaction is considered expired | |
| +INFO main Bootstrap transaction.max-finishing-concurrency 1 1 Maximum parallelism for committing or aborting a transaction | |
| +INFO main Bootstrap discovery.uri null http://ip-172-31-29-54.ap-northeast-1.compute.internal:8889 Discovery service base URI | |
| +INFO main Bootstrap service-inventory.uri null null Service inventory base URI | |
| +INFO main Bootstrap service-inventory.update-interval 10.00s 10.00s Service inventory update interval | |
| -INFO main Bootstrap failure-detector.http-client.authentication.enabled false false Enable client authentication | |
| +INFO main Bootstrap failure-detector.http-client.authentication.enabled false false Enable client authentication | |
| -INFO main Bootstrap failure-detector.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| +INFO main Bootstrap failure-detector.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| -INFO main Bootstrap failure-detector.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| -INFO main Bootstrap failure-detector.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| +INFO main Bootstrap failure-detector.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| +INFO main Bootstrap failure-detector.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| -INFO main Bootstrap memoryManager.http-client.authentication.enabled false false Enable client authentication | |
| +INFO main Bootstrap memoryManager.http-client.authentication.enabled false false Enable client authentication | |
| -INFO main Bootstrap memoryManager.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| +INFO main Bootstrap memoryManager.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| -INFO main Bootstrap memoryManager.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| -INFO main Bootstrap memoryManager.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| +INFO main Bootstrap memoryManager.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| +INFO main Bootstrap memoryManager.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| -INFO main Bootstrap node-manager.http-client.authentication.enabled false false Enable client authentication | |
| +INFO main Bootstrap node-manager.http-client.authentication.enabled false false Enable client authentication | |
| -INFO main Bootstrap node-manager.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| +INFO main Bootstrap node-manager.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| -INFO main Bootstrap node-manager.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| -INFO main Bootstrap node-manager.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| +INFO main Bootstrap node-manager.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| +INFO main Bootstrap node-manager.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| -INFO main Bootstrap exchange.http-client.authentication.enabled false false Enable client authentication | |
| +INFO main Bootstrap exchange.http-client.authentication.enabled false false Enable client authentication | |
| -INFO main Bootstrap exchange.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| +INFO main Bootstrap exchange.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| -INFO main Bootstrap exchange.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| -INFO main Bootstrap exchange.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| +INFO main Bootstrap exchange.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| +INFO main Bootstrap exchange.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| -INFO main Bootstrap scheduler.http-client.authentication.enabled false false Enable client authentication | |
| +INFO main Bootstrap scheduler.http-client.authentication.enabled false false Enable client authentication | |
| -INFO main Bootstrap scheduler.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| +INFO main Bootstrap scheduler.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| -INFO main Bootstrap scheduler.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| -INFO main Bootstrap scheduler.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| +INFO main Bootstrap scheduler.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| +INFO main Bootstrap scheduler.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| -INFO main Bootstrap workerInfo.http-client.authentication.enabled false false Enable client authentication | |
| -INFO main Bootstrap workerInfo.http-client.connect-timeout 1.00s 1.00s | |
| -INFO main Bootstrap workerInfo.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| -INFO main Bootstrap workerInfo.http-client.idle-timeout 1.00m 1.00m | |
| -INFO main Bootstrap workerInfo.http-client.keep-alive-interval null null | |
| -INFO main Bootstrap workerInfo.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| -INFO main Bootstrap workerInfo.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| -INFO main Bootstrap workerInfo.http-client.key-store-password null null | |
| -INFO main Bootstrap workerInfo.http-client.key-store-path null null | |
| -INFO main Bootstrap workerInfo.http-client.max-connections 200 200 | |
| -INFO main Bootstrap workerInfo.http-client.max-connections-per-server 20 20 | |
| -INFO main Bootstrap workerInfo.http-client.max-content-length 16MB 16MB | |
| -INFO main Bootstrap workerInfo.http-client.max-requests-queued-per-destination 1024 1024 | |
| -INFO main Bootstrap workerInfo.http-client.request-timeout 5.00m 5.00m | |
| -INFO main Bootstrap workerInfo.http-client.secure-random-algorithm null null | |
| -INFO main Bootstrap workerInfo.http-client.socks-proxy null null | |
| -INFO main Bootstrap workerInfo.http-client.trust-store-password null null | |
| -INFO main Bootstrap workerInfo.http-client.trust-store-path null null | |
| -INFO main Bootstrap discovery.http-client.authentication.enabled false false Enable client authentication | |
| +INFO main Bootstrap discovery.http-client.authentication.enabled false false Enable client authentication | |
| -INFO main Bootstrap discovery.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| +INFO main Bootstrap discovery.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| -INFO main Bootstrap discovery.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| -INFO main Bootstrap discovery.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| +INFO main Bootstrap discovery.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| +INFO main Bootstrap discovery.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| -INFO main Bootstrap dynamic.http-client.authentication.enabled false false Enable client authentication | |
| +INFO main Bootstrap dynamic.http-client.authentication.enabled false false Enable client authentication | |
| -INFO main Bootstrap dynamic.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| +INFO main Bootstrap dynamic.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| -INFO main Bootstrap dynamic.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| -INFO main Bootstrap dynamic.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| +INFO main Bootstrap dynamic.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| +INFO main Bootstrap dynamic.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| -INFO main Bootstrap event.http-client.authentication.enabled false false Enable client authentication | |
| +INFO main Bootstrap event.http-client.authentication.enabled false false Enable client authentication | |
| -INFO main Bootstrap event.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| +INFO main Bootstrap event.http-client.http2.enabled false false Enable the HTTP/2 transport | |
| -INFO main Bootstrap event.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| -INFO main Bootstrap event.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| +INFO main Bootstrap event.http-client.authentication.krb5.principal null null Set kerberos client principal | |
| +INFO main Bootstrap event.http-client.authentication.krb5.remote-service-name null null Set kerberos service principal name | |
| -INFO main Bootstrap http.authentication.krb5.config null null Set kerberos configuration path | |
| -INFO main Bootstrap http.authentication.krb5.credential-cache null null Set kerberos credential cache path | |
| -INFO main Bootstrap http.authentication.krb5.keytab null null Set kerberos key table path | |
| -INFO main Bootstrap http.authentication.krb5.use-canonical-hostname true true Canonicalize service hostname using the DNS reverse lookup | |
| +INFO main Bootstrap http.authentication.krb5.config null null Set kerberos configuration path | |
| +INFO main Bootstrap http.authentication.krb5.credential-cache null null Set kerberos credential cache path | |
| +INFO main Bootstrap http.authentication.krb5.keytab null null Set kerberos key table path | |
| +INFO main Bootstrap http.authentication.krb5.use-canonical-hostname true true Canonicalize service hostname using the DNS reverse lookup | |
| -INFO main Bootstrap http-server.http2.max-concurrent-streams 16384 16384 Maximum concurrent streams per connection for HTTP/2 | |
| +INFO main Bootstrap http-server.http2.max-concurrent-streams 16384 16384 Maximum concurrent streams per connection for HTTP/2 | |
| -INFO main Bootstrap http-server.http.port 8080 8080 | |
| +INFO main Bootstrap http-server.http.port 8080 8889 | |
| -INFO main Bootstrap http-server.https.keystore.key [REDACTED] [REDACTED] | |
| +INFO main Bootstrap http-server.https.keymanager.password null null | |
| +INFO main Bootstrap http-server.https.keystore.key null null | |
| -INFO main Bootstrap http-server.log.max-history 15 15 | |
| -INFO main Bootstrap http-server.log.max-size 9223372036854775807B 9223372036854775807B | |
| -INFO main Bootstrap http-server.log.path var/log/http-request.log var/log/http-request.log | |
| +INFO main Bootstrap http-server.log.max-history 15 5 | |
| +INFO main Bootstrap http-server.log.max-size 9223372036854775807B 67108864B | |
| +INFO main Bootstrap http-server.log.path var/log/http-request.log /var/log/presto/http-request.log | |
| -INFO main Bootstrap http-server.threads.max 200 200 | |
| +INFO main Bootstrap http-server.threads.max 200 500 | |
| -INFO main Bootstrap http-server.show-stack-trace true true Show the stack trace when generating an error response | |
| +INFO main Bootstrap http-server.show-stack-trace true true Show the stack trace when generating an error response | |
| -INFO main Bootstrap node.id null ffffffff-ffff-ffff-ffff-ffffffffffff | |
| +INFO main Bootstrap node.id null i-06ae3b9bda98776aa | |
| -INFO main io.airlift.jmx.JmxAgent JMX agent started and listening on ReijinoMacBook-Pro.local:58242 | |
| -ERROR Discovery-0 io.airlift.discovery.client.CachingServiceSelector Cannot connect to discovery server for refresh (presto/general): Lookup of presto failed for http://localhost:8080/v1/service/presto/general | |
| -ERROR Discovery-1 io.airlift.discovery.client.CachingServiceSelector Cannot connect to discovery server for refresh (collector/general): Lookup of collector failed for http://localhost:8080/v1/service/collector/general | |
| -WARN http-client-shared-19 com.facebook.presto.metadata.RemoteNodeState Error fetching node state from http://192.168.100.145:8080/v1/info/state: Server refused connection: http://192.168.100.145:8080/v1/info/state | |
| +INFO main io.airlift.jmx.JmxAgent JMX agent started and listening on ip-172-31-29-54:44168 | |
| +ERROR Discovery-0 io.airlift.discovery.client.CachingServiceSelector Cannot connect to discovery server for refresh (presto/general): Lookup of presto failed for http://ip-172-31-29-54.ap-northeast-1.compute.internal:8889/v1/service/presto/general | |
| +WARN http-client-shared-17 com.facebook.presto.metadata.RemoteNodeState Error fetching node state from http://172.31.29.54:8889/v1/info/state: Server refused connection: http://172.31.29.54:8889/v1/info/state | |
| +ERROR Discovery-3 io.airlift.discovery.client.CachingServiceSelector Cannot connect to discovery server for refresh (collector/general): Lookup of collector failed for http://ip-172-31-29-54.ap-northeast-1.compute.internal:8889/v1/service/collector/general | |
| -WARN main org.eclipse.jetty.server.handler.AbstractHandler No Server set for org.eclipse.jetty.server.handler.ErrorHandler@2cca611f | |
| -INFO main org.eclipse.jetty.server.handler.ContextHandler Started o.e.j.s.ServletContextHandler@52c9d3d0{/,null,AVAILABLE,@http} | |
| -INFO main org.eclipse.jetty.server.AbstractConnectorStarted http@7b25ab31{HTTP/1.1,[http/1.1, h2c, h2c-17, h2c-16, h2c-15, h2c-14]}{0.0.0.0:8080} | |
| -INFO main org.eclipse.jetty.server.Server Started @4387ms | |
| -INFO Discovery-3 io.airlift.discovery.client.CachingServiceSelector Discovery server connect succeeded for refresh (presto/general) | |
| -INFO Discovery-1 io.airlift.discovery.client.CachingServiceSelector Discovery server connect succeeded for refresh (collector/general) | |
| +WARN main org.eclipse.jetty.server.handler.AbstractHandler No Server set for org.eclipse.jetty.server.handler.ErrorHandler@5099c59b | |
| +WARN query-management-0 com.facebook.presto.memory.RemoteNodeMemory Error fetching memory info from http://172.31.29.54:8889/v1/memory: Server refused connection: http://172.31.29.54:8889/v1/memory | |
| +INFO main org.eclipse.jetty.server.handler.ContextHandler Started o.e.j.s.ServletContextHandler@13ed066e{/,null,AVAILABLE,@http} | |
| +INFO main org.eclipse.jetty.server.AbstractConnector Started http@5b202ff{HTTP/1.1,[http/1.1, h2c, h2c-17, h2c-16, h2c-15, h2c-14]}{0.0.0.0:8889} | |
| +INFO main org.eclipse.jetty.server.Server Started @6951ms | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/accumulo -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/accumulo -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/accumulo -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/atop -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/accumulo -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/atop -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/atop -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/blackhole -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/atop -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/blackhole -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/blackhole -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/cassandra -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/blackhole -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/cassandra -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/cassandra -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/example-http -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/cassandra -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/example-http -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/example-http -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/hive-hadoop2 -- | |
| +INFO Discovery-4 io.airlift.discovery.client.CachingServiceSelector Discovery server connect succeeded for refresh (presto/general) | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/example-http -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/hive-hadoop2 -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/hive-hadoop2 -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/jmx -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/hive-hadoop2 -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/jmx -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/jmx -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/kafka -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/jmx -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/kafka -- | |
| +INFO Discovery-2 io.airlift.discovery.client.CachingServiceSelector Discovery server connect succeeded for refresh (collector/general) | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/kafka -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/localfile -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/kafka -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/localfile -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/localfile -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/memory -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/localfile -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/memory -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/memory -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/ml -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/memory -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/ml -- | |
| -INFO main com.facebook.presto.server.PluginManager Registering functions from com.facebook.presto.ml.MLFeaturesFunctions | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/ml -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/mongodb -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/ml -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/mongodb -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/mongodb -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/mysql -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/mongodb -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/mysql -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/mysql -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/postgresql -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/mysql -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/postgresql -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/postgresql -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/presto-fluentd -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/postgresql -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/presto-fluentd -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/presto-fluentd -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/presto-thrift -- | |
| -INFO main com.facebook.presto.server.PluginManager Installing com.facebook.presto.connector.thrift.ThriftPlugin | |
| -INFO main com.facebook.presto.server.PluginManager Registering connector presto-thrift | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/presto-thrift -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/raptor -- | |
| -INFO main com.facebook.presto.server.PluginManager Installing com.facebook.presto.raptor.RaptorPlugin | |
| -INFO main com.facebook.presto.server.PluginManager Registering connector raptor | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/raptor -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/redis -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/presto-fluentd -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/redis -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/redis -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/resource-group-managers -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/redis -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/resource-group-managers -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/resource-group-managers -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/sqlserver -- | |
| -INFO main com.facebook.presto.server.PluginManager Installing com.facebook.presto.plugin.sqlserver.SqlServerPlugin | |
| -INFO main com.facebook.presto.server.PluginManager Registering connector sqlserver | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/sqlserver -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/teradata-functions -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/resource-group-managers -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/teradata-functions -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/teradata-functions -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/tpcds -- | |
| -INFO main com.facebook.presto.server.PluginManager Installing com.facebook.presto.tpcds.TpcdsPlugin | |
| -INFO main com.facebook.presto.server.PluginManager Registering connector tpcds | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/tpcds -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/local/var/presto/data/plugin/tpch -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/teradata-functions -- | |
| +INFO main com.facebook.presto.server.PluginManager -- Loading plugin /usr/lib/presto/plugin/tpch -- | |
| -INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/local/var/presto/data/plugin/tpch -- | |
| -INFO main com.facebook.presto.metadata.StaticCatalogStore -- Loading catalog etc/catalog/jmx.properties -- | |
| -INFO main Bootstrap PROPERTY DEFAULT RUNTIME DESCRIPTION | |
| -INFO main Bootstrap jmx.dump-period 10.00s 10.00s | |
| -INFO main Bootstrap jmx.dump-tables [] [] | |
| -INFO main Bootstrap jmx.max-entries 86400 86400 | |
| +INFO main com.facebook.presto.server.PluginManager -- Finished loading plugin /usr/lib/presto/plugin/tpch -- | |
| +INFO main com.facebook.presto.metadata.StaticCatalogStore -- Loading catalog /etc/presto/conf/catalog/mysql.properties -- | |
| +INFO main Bootstrap PROPERTY DEFAULT RUNTIME DESCRIPTION | |
| +INFO main Bootstrap connection-password null hogehoge | |
| +INFO main Bootstrap connection-url null hogehoge | |
| +INFO main Bootstrap connection-user null hogehoge | |
| +INFO main Bootstrap allow-drop-table false false Allow connector to drop tables | |
| +INFO main Bootstrap mysql.auto-reconnect true true | |
| +INFO main Bootstrap mysql.connection-timeout 10.00s 10.00s | |
| +INFO main Bootstrap mysql.max-reconnects 3 3 | |
| -INFO main com.facebook.presto.metadata.StaticCatalogStore -- Added catalog jmx using connector jmx -- | |
| +INFO main com.facebook.presto.metadata.StaticCatalogStore -- Added catalog mysql using connector mysql -- | |
| +INFO main com.facebook.presto.metadata.StaticCatalogStore -- Loading catalog /etc/presto/conf/catalog/hive.properties -- | |
| +INFO main Bootstrap PROPERTY DEFAULT RUNTIME DESCRIPTION | |
| +INFO main Bootstrap hive.allow-corrupt-writes-for-testing false false Allow Hive connector to write data even when data will likely be corrupt | |
| +INFO main Bootstrap hive.assume-canonical-partition-keys false false | |
| +INFO main Bootstrap hive.bucket-execution true true Enable bucket-aware execution: only use a single worker per bucket | |
| +INFO main Bootstrap hive.bucket-writing true true Enable writing to bucketed tables | |
| +INFO main Bootstrap hive.dfs.connect.max-retries 5 5 | |
| +INFO main Bootstrap hive.dfs.connect.timeout 500.00ms 500.00ms | |
| +INFO main Bootstrap hive.dfs-timeout 60.00s 60.00s | |
| +INFO main Bootstrap hive.domain-compaction-threshold 100 100 Maximum ranges to allow in a tuple domain without compacting it | |
| +INFO main Bootstrap hive.dfs.domain-socket-path null null | |
| +INFO main Bootstrap hive.fs.cache.max-size 1000 1000 Hadoop FileSystem cache size | |
| +INFO main Bootstrap hive.force-local-scheduling false false | |
| +INFO main Bootstrap hive.hdfs.authentication.type NONE NONE HDFS authentication type | |
| +INFO main Bootstrap hive.hdfs.impersonation.enabled false false Should Presto user be impersonated when communicating with HDFS | |
| +INFO main Bootstrap hive.hdfs.presto.keytab null null Presto keytab used to access HDFS | |
| +INFO main Bootstrap hive.hdfs.presto.principal null null Presto principal used to access HDFS | |
| +INFO main Bootstrap hive.compression-codec GZIP GZIP | |
| +INFO main Bootstrap hive.external-table-writable false true | |
| +INFO main Bootstrap hive.metastore.authentication.type NONE NONE Hive Metastore authentication type | |
| +INFO main Bootstrap hive.metastore.client.keytab null null Hive Metastore client keytab location | |
| +INFO main Bootstrap hive.metastore.client.principal null null Hive Metastore client principal | |
| +INFO main Bootstrap hive.metastore.service.principal null null Hive Metastore service principal | |
| +INFO main Bootstrap hive.storage-format RCBINARY RCBINARY | |
| +INFO main Bootstrap hive.immutable-partitions false false Can new data be inserted into existing partitions or existing unpartitioned tables | |
| +INFO main Bootstrap hive.dfs.ipc-ping-interval 10.00s 10.00s | |
| +INFO main Bootstrap hive.max-concurrent-file-renames 20 20 | |
| +INFO main Bootstrap hive.max-initial-split-size 32MB 32MB | |
| +INFO main Bootstrap hive.max-initial-splits 200 200 | |
| +INFO main Bootstrap hive.metastore-refresh-max-threads 100 100 | |
| +INFO main Bootstrap hive.max-outstanding-splits 1000 1000 | |
| +INFO main Bootstrap hive.metastore.partition-batch-size.max 100 100 | |
| +INFO main Bootstrap hive.max-partitions-per-scan 100000 100000 Maximum allowed partitions for a single table scan | |
| +INFO main Bootstrap hive.max-partitions-per-writers 100 100 Maximum number of partitions per writer | |
| +INFO main Bootstrap hive.max-split-iterator-threads 1000 1000 | |
| +INFO main Bootstrap hive.max-split-size 64MB 64MB | |
| +INFO main Bootstrap hive.metastore-cache-maximum-size 10000 10000 | |
| +INFO main Bootstrap hive.metastore-cache-ttl 1.00h 20.00m | |
| +INFO main Bootstrap hive.metastore-refresh-interval 1.00s 1.00m | |
| +INFO main Bootstrap hive.metastore.thrift.client.socks-proxy null null | |
| +INFO main Bootstrap hive.metastore-timeout 10.00s 10.00s | |
| +INFO main Bootstrap hive.metastore.partition-batch-size.min 10 10 | |
| +INFO main Bootstrap hive.orc.bloom-filters.enabled false false | |
| +INFO main Bootstrap hive.orc.max-buffer-size 8MB 8MB | |
| +INFO main Bootstrap hive.orc.max-merge-distance 1MB 1MB | |
| +INFO main Bootstrap hive.orc.stream-buffer-size 8MB 8MB | |
| +INFO main Bootstrap hive.parquet-optimized-reader.enabled false false | |
| +INFO main Bootstrap hive.parquet-predicate-pushdown.enabled false false | |
| +INFO main Bootstrap hive.per-transaction-metastore-cache-maximum-size 1000 1000 | |
| +INFO main Bootstrap hive.rcfile-optimized-reader.enabled true true | |
| +INFO main Bootstrap hive.rcfile-optimized-writer.enabled false false | |
| +INFO main Bootstrap hive.recursive-directories false false | |
| +INFO main Bootstrap hive.config.resources null [/etc/hadoop/conf/core-site.xml, /etc/hadoop/conf/hdfs-site.xml] | |
| +INFO main Bootstrap hive.respect-table-format true true Should new partitions be written using the existing table format or the default Presto format | |
| +INFO main Bootstrap hive.skip-deletion-for-alter false false Skip deletion of old partition data when a partition is deleted and then inserted in the same transaction | |
| +INFO main Bootstrap hive.time-zone Universal Universal | |
| +INFO main Bootstrap hive.orc.use-column-names false false Access ORC columns using names from the file | |
| +INFO main Bootstrap hive.parquet.use-column-names false false Access Parquet columns using names from the file | |
| +INFO main Bootstrap hive.dfs.verify-checksum true true | |
| +INFO main Bootstrap hive.write-validation-threads 16 16 Number of threads used for verifying data after a write | |
| +INFO main Bootstrap hive.s3.pin-client-to-current-region false false Should the S3 client be pinned to the current EC2 region | |
| +INFO main Bootstrap hive.s3.aws-access-key null null | |
| +INFO main Bootstrap hive.s3.aws-secret-key null null | |
| +INFO main Bootstrap hive.s3.connect-timeout 5.00s 2.00m | |
| +INFO main Bootstrap hive.s3.encryption-materials-provider null null Use a custom encryption materials provider for S3 data encryption | |
| +INFO main Bootstrap hive.s3.endpoint null null | |
| +INFO main Bootstrap hive.s3.kms-key-id null null Use an AWS KMS key for S3 data encryption | |
| +INFO main Bootstrap hive.s3.max-backoff-time 10.00m 10.00m | |
| +INFO main Bootstrap hive.s3.max-client-retries 3 50 | |
| +INFO main Bootstrap hive.s3.max-connections 500 500 | |
| +INFO main Bootstrap hive.s3.max-error-retries 10 50 | |
| +INFO main Bootstrap hive.s3.max-retry-time 10.00m 10.00m | |
| +INFO main Bootstrap hive.s3.multipart.min-file-size 16MB 16MB Minimum file size for an S3 multipart upload | |
| +INFO main Bootstrap hive.s3.multipart.min-part-size 5MB 5MB Minimum part size for an S3 multipart upload | |
| +INFO main Bootstrap hive.s3.signer-type null null | |
| +INFO main Bootstrap hive.s3.socket-timeout 5.00s 2.00m | |
| +INFO main Bootstrap hive.s3.sse.enabled false false Enable S3 server side encryption | |
| +INFO main Bootstrap hive.s3.sse.kms-key-id null null KMS Key ID to use for S3 server-side encryption with KMS-managed key | |
| +INFO main Bootstrap hive.s3.sse.type S3 S3 Key management type for S3 server-side encryption (S3 or KMS) | |
| +INFO main Bootstrap hive.s3.ssl.enabled true true | |
| +INFO main Bootstrap hive.s3.staging-directory /tmp /mnt/tmp Temporary directory for staging files before uploading to S3 | |
| +INFO main Bootstrap hive.s3.use-instance-credentials true true | |
| +INFO main Bootstrap hive.s3.user-agent-prefix The user agent prefix to use for S3 calls | |
| +INFO main Bootstrap hive.metastore.uri null [thrift://ip-172-31-29-54.ap-northeast-1.compute.internal:9083] Hive metastore URIs (comma separated) | |
| +INFO main Bootstrap hive.metastore thrift thrift | |
| +INFO main Bootstrap hive.allow-add-column false false Allow Hive connector to add column | |
| +INFO main Bootstrap hive.allow-drop-table false false Allow Hive connector to drop table | |
| +INFO main Bootstrap hive.allow-rename-column false false Allow Hive connector to rename column | |
| +INFO main Bootstrap hive.allow-rename-table false false Allow Hive connector to rename table | |
| +INFO main Bootstrap hive.security legacy legacy | |
| +INFO main Bootstrap | |
| +INFO main com.facebook.presto.metadata.StaticCatalogStore -- Added catalog hive using connector hive-hadoop2 -- | |
| -INFO main com.facebook.presto.eventlistener.EventListenerManager -- Loading event listener -- | |
| -INFO main stderr SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". | |
| -INFO main stderr SLF4J: Defaulting to no-operation (NOP) logger implementation | |
| -INFO main stderr SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. | |
| -INFO main com.facebook.presto.eventlistener.EventListenerManager -- Loaded event listener presto-fluentd -- | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment