istio-ingress-gateway-debug-logs-with-request_headers

Envoy (Epoch 0)] [2020-04-29 12:43:51.552][22][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:1276] [C1][S6875242954525267416] request end stream
[Envoy (Epoch 0)] [2020-04-29 12:43:51.552][22][debug][admin] [external/envoy/source/server/http/admin.cc:1343] [C1][S6875242954525267416] request complete: path: /stats?usedonly&filter=server.state
[Envoy (Epoch 0)] [2020-04-29 12:43:51.556][22][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:1615] [C1][S6875242954525267416] encoding headers via codec (end_stream=false):
':status', '200'
'content-type', 'text/plain; charset=UTF-8'
'cache-control', 'no-cache, max-age=0'
'x-content-type-options', 'nosniff'
'date', 'Wed, 29 Apr 2020 12:43:51 GMT'
'server', 'envoy'

[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][conn_handler] [external/envoy/source/server/connection_handler_impl.cc:353] [C419] new connection
[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:263] [C419] new stream
[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:731] [C419][S17421124528116498558] request headers complete (end_stream=true):
':authority', 'abcdefghi.xxxxx.com'
':path', '/api/v2/activities'
':method', 'GET'
'user-agent', 'curl/7.61.1'
'accept', '*/*'

[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:1276] [C419][S17421124528116498558] request end stream
[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][router] [external/envoy/source/common/router/router.cc:474] [C419][S17421124528116498558] cluster 'outbound|80||microservice-service.microservice-istio.svc.cluster.local' match for URL '/api/v2/activities'
[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][router] [external/envoy/source/common/router/router.cc:614] [C419][S17421124528116498558] router decoding headers:
':authority', 'abcdefghi.xxxxx.com'
':path', '/api/v2/activities'
':method', 'GET'
':scheme', 'https'
'user-agent', 'curl/7.61.1'
'accept', '*/*'
'x-forwarded-for', '172.16.1.69'
'x-forwarded-proto', 'http'
'x-envoy-internal', 'true'
'x-request-id', '8d6a649c-3405-9f09-9c57-b258ac01d769'
'x-envoy-decorator-operation', 'microservice-service.microservice-istio.svc.cluster.local:80/api/v2/activities*'
'x-envoy-peer-metadata', 'Ch4KDElOU1RBTkNFX0lQUxIOGgwxNzIuMTYuNTcuNTQKkwIKBkxBQkVMUxKIAiqFAgodCgNhcHASFhoUaXN0aW8taW5ncmVzc2dhdGV3YXkKEwoFY2hhcnQSChoIZ2F0ZXdheXMKFAoIaGVyaXRhZ2USCBoGVGlsbGVyChkKBWlzdGlvEhAaDmluZ3Jlc3NnYXRld2F5CiEKEXBvZC10ZW1wbGF0ZS1oYXNoEgwaCjU5ODc5NmY0ZDkKEgoHcmVsZWFzZRIHGgVpc3Rpbwo5Ch9zZXJ2aWNlLmlzdGlvLmlvL2Nhbm9uaWNhbC1uYW1lEhYaFGlzdGlvLWluZ3Jlc3NnYXRld2F5CiwKI3NlcnZpY2UuaXN0aW8uaW8vY2Fub25pY2FsLXJldmlzaW9uEgUaAzEuNQoaCgdNRVNIX0lEEg8aDWNsdXN0ZXIubG9jYWwKLwoETkFNRRInGiVpc3Rpby1pbmdyZXNzZ2F0ZXdheS01OTg3OTZmNGQ5LWg0dmg2ChsKCU5BTUVTUEFDRRIOGgxpc3Rpby1zeXN0ZW0KXQoFT1dORVISVBpSa3ViZXJuZXRlczovL2FwaXMvYXBwcy92MS9uYW1lc3BhY2VzL2lzdGlvLXN5c3RlbS9kZXBsb3ltZW50cy9pc3Rpby1pbmdyZXNzZ2F0ZXdheQqnAQoRUExBVEZPUk1fTUVUQURBVEESkQEqjgEKIAoOYXdzX2FjY291bnRfaWQSDhoMMjEzMjkzOTI3MjM0CiUKFWF3c19hdmFpbGFiaWxpdHlfem9uZRIMGgp1cy1lYXN0LTFkCigKD2F3c19pbnN0YW5jZV9pZBIVGhNpLTBjOTEwZjhiMDE3NTExZGE4ChkKCmF3c19yZWdpb24SCxoJdXMtZWFzdC0xCjkKD1NFUlZJQ0VfQUNDT1VOVBImGiRpc3Rpby1pbmdyZXNzZ2F0ZXdheS1zZXJ2aWNlLWFjY291bnQKJwoNV09SS0xPQURfTkFNRRIWGhRpc3Rpby1pbmdyZXNzZ2F0ZXdheQ=='
'x-envoy-peer-metadata-id', 'router~xxx.xx.xx.xx~istio-ingressgateway-598796f4d9-h4vh6.istio-system~istio-system.svc.cluster.local'
'x-b3-traceid', '503248d5ac36dd22da6e1bf579ce1554'
'x-b3-spanid', 'da6e1bf579ce1554'
'x-b3-sampled', '1'

[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:95] creating a new connection
[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][client] [external/envoy/source/common/http/codec_client.cc:34] [C420] connecting
[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:698] [C420] connecting to 172.16.48.26:8080
[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:707] [C420] connection in progress
[Envoy (Epoch 0)] [2020-04-29 12:43:52.897][37][debug][pool] [external/envoy/source/common/http/conn_pool_base.cc:55] queueing request due to no available connections
[Envoy (Epoch 0)] [2020-04-29 12:43:52.898][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:570] [C420] connected
[Envoy (Epoch 0)] [2020-04-29 12:43:52.898][37][debug][connection] [external/envoy/source/extensions/transport_sockets/tls/ssl_socket.cc:191] [C420] handshake expecting read
[Envoy (Epoch 0)] [2020-04-29 12:43:52.900][37][debug][connection] [external/envoy/source/extensions/transport_sockets/tls/ssl_socket.cc:198] [C420] handshake error: 5
[Envoy (Epoch 0)] [2020-04-29 12:43:52.900][37][debug][connection] [external/envoy/source/extensions/transport_sockets/tls/ssl_socket.cc:226] [C420]
[Envoy (Epoch 0)] [2020-04-29 12:43:52.900][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:192] [C420] closing socket: 0
[Envoy (Epoch 0)] [2020-04-29 12:43:52.900][37][debug][client] [external/envoy/source/common/http/codec_client.cc:91] [C420] disconnect. resetting 0 pending requests
[Envoy (Epoch 0)] [2020-04-29 12:43:52.900][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:136] [C420] client disconnected, failure reason:
[Envoy (Epoch 0)] [2020-04-29 12:43:52.900][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:166] [C420] purge pending, failure reason:
[Envoy (Epoch 0)] [2020-04-29 12:43:52.900][37][debug][router] [external/envoy/source/common/router/router.cc:990] [C419][S17421124528116498558] upstream reset: reset reason connection failure
[Envoy (Epoch 0)] [2020-04-29 12:43:52.900][37][debug][router] [external/envoy/source/common/router/router.cc:1357] [C419][S17421124528116498558] performing retry
[Envoy (Epoch 0)] [2020-04-29 12:43:52.909][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:95] creating a new connection
[Envoy (Epoch 0)] [2020-04-29 12:43:52.909][37][debug][client] [external/envoy/source/common/http/codec_client.cc:34] [C421] connecting
[Envoy (Epoch 0)] [2020-04-29 12:43:52.909][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:698] [C421] connecting to 172.16.48.26:8080
[Envoy (Epoch 0)] [2020-04-29 12:43:52.909][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:707] [C421] connection in progress
[Envoy (Epoch 0)] [2020-04-29 12:43:52.909][37][debug][pool] [external/envoy/source/common/http/conn_pool_base.cc:55] queueing request due to no available connections
[Envoy (Epoch 0)] [2020-04-29 12:43:52.910][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:570] [C421] connected
[Envoy (Epoch 0)] [2020-04-29 12:43:52.910][37][debug][connection] [external/envoy/source/extensions/transport_sockets/tls/ssl_socket.cc:191] [C421] handshake expecting read
[Envoy (Epoch 0)] [2020-04-29 12:43:52.912][37][debug][connection] [external/envoy/source/extensions/transport_sockets/tls/ssl_socket.cc:198] [C421] handshake error: 5
[Envoy (Epoch 0)] [2020-04-29 12:43:52.912][37][debug][connection] [external/envoy/source/extensions/transport_sockets/tls/ssl_socket.cc:226] [C421]
[Envoy (Epoch 0)] [2020-04-29 12:43:52.912][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:192] [C421] closing socket: 0
[Envoy (Epoch 0)] [2020-04-29 12:43:52.912][37][debug][client] [external/envoy/source/common/http/codec_client.cc:91] [C421] disconnect. resetting 0 pending requests
[Envoy (Epoch 0)] [2020-04-29 12:43:52.912][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:136] [C421] client disconnected, failure reason:
[Envoy (Epoch 0)] [2020-04-29 12:43:52.912][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:166] [C421] purge pending, failure reason:
[Envoy (Epoch 0)] [2020-04-29 12:43:52.912][37][debug][router] [external/envoy/source/common/router/router.cc:990] [C419][S17421124528116498558] upstream reset: reset reason connection failure
[Envoy (Epoch 0)] [2020-04-29 12:43:52.912][37][debug][router] [external/envoy/source/common/router/router.cc:1357] [C419][S17421124528116498558] performing retry
[Envoy (Epoch 0)] [2020-04-29 12:43:52.955][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:95] creating a new connection
[Envoy (Epoch 0)] [2020-04-29 12:43:52.955][37][debug][client] [external/envoy/source/common/http/codec_client.cc:34] [C422] connecting
[Envoy (Epoch 0)] [2020-04-29 12:43:52.955][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:698] [C422] connecting to 172.16.48.26:8080
[Envoy (Epoch 0)] [2020-04-29 12:43:52.955][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:707] [C422] connection in progress
[Envoy (Epoch 0)] [2020-04-29 12:43:52.955][37][debug][pool] [external/envoy/source/common/http/conn_pool_base.cc:55] queueing request due to no available connections
[Envoy (Epoch 0)] [2020-04-29 12:43:52.956][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:570] [C422] connected
[Envoy (Epoch 0)] [2020-04-29 12:43:52.956][37][debug][connection] [external/envoy/source/extensions/transport_sockets/tls/ssl_socket.cc:191] [C422] handshake expecting read
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][connection] [external/envoy/source/extensions/transport_sockets/tls/ssl_socket.cc:198] [C422] handshake error: 5
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][connection] [external/envoy/source/extensions/transport_sockets/tls/ssl_socket.cc:226] [C422]
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:192] [C422] closing socket: 0
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][client] [external/envoy/source/common/http/codec_client.cc:91] [C422] disconnect. resetting 0 pending requests
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:136] [C422] client disconnected, failure reason:
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:166] [C422] purge pending, failure reason:
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][router] [external/envoy/source/common/router/router.cc:990] [C419][S17421124528116498558] upstream reset: reset reason connection failure
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:1417] [C419][S17421124528116498558] Sending local reply with details upstream_reset_before_response_started{connection failure}
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:1615] [C419][S17421124528116498558] encoding headers via codec (end_stream=false):
':status', '503'
'content-length', '91'
'content-type', 'text/plain'
'date', 'Wed, 29 Apr 2020 12:43:52 GMT'
'server', 'istio-envoy'

[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][wasm] [external/envoy/source/extensions/common/wasm/context.cc:1074] wasm log stats_outbound: [extensions/common/node_info_cache.cc:63]::getPeerById() cannot get metadata for: envoy.wasm.metadata_exchange.upstream_id
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][wasm] [external/envoy/source/extensions/common/wasm/context.cc:1074] wasm log stats_outbound: [extensions/stats/plugin.cc:505]::report() metricKey cache hit , stat=20
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][wasm] [external/envoy/source/extensions/common/wasm/context.cc:1074] wasm log stats_outbound: [extensions/stats/plugin.cc:505]::report() metricKey cache hit , stat=30
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][wasm] [external/envoy/source/extensions/common/wasm/context.cc:1074] wasm log stats_outbound: [extensions/stats/plugin.cc:505]::report() metricKey cache hit , stat=34
[Envoy (Epoch 0)] [2020-04-29 12:43:52.957][37][debug][wasm] [external/envoy/source/extensions/common/wasm/context.cc:1074] wasm log stats_outbound: [extensions/stats/plugin.cc:505]::report() metricKey cache hit , stat=38
[Envoy (Epoch 0)] [2020-04-29 12:43:52.959][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:538] [C419] remote close
[Envoy (Epoch 0)] [2020-04-29 12:43:52.959][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:192] [C419] closing socket: 0
[Envoy (Epoch 0)] [2020-04-29 12:43:52.959][37][debug][conn_handler] [external/envoy/source/server/connection_handler_impl.cc:86] [C419] adding to cleanup list
[Envoy (Epoch 0)] [2020-04-29 12:43:53.115][22][debug][upstream] [external/envoy/source/common/upstream/upstream_impl.cc:262] transport socket match, socket default selected for host with address 172.16.1.75:81
[Envoy (Epoch 0)] [2020-04-29 12:43:53.552][22][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:263] [C1] new stream
[Envoy (Epoch 0)] [2020-04-29 12:43:53.552][22][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:731] [C1][S11355207005656425252] request headers complete (end_stream=true):
':authority', '127.0.0.1:15000'
':path', '/stats?usedonly&filter=server.state'
':method', 'GET'
'user-agent', 'Go-http-client/1.1'
'accept-encoding', 'gzip'

[Envoy (Epoch 0)] [2020-04-29 12:43:53.552][22][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:1276] [C1][S11355207005656425252] request end stream
[Envoy (Epoch 0)] [2020-04-29 12:43:53.552][22][debug][admin] [external/envoy/source/server/http/admin.cc:1343] [C1][S11355207005656425252] request complete: path: /stats?usedonly&filter=server.state
[Envoy (Epoch 0)] [2020-04-29 12:43:53.556][22][debug][http] [external/envoy/source/common/http/conn_manager_impl.cc:1615] [C1][S11355207005656425252] encoding headers via codec (end_stream=false):
':status', '200'
'content-type', 'text/plain; charset=UTF-8'
'cache-control', 'no-cache, max-age=0'
'x-content-type-options', 'nosniff'
'date', 'Wed, 29 Apr 2020 12:43:53 GMT'
'server', 'envoy'

[Envoy (Epoch 0)] [2020-04-29 12:43:54.678][37][debug][router] [external/envoy/source/common/router/router.cc:474] [C0][S10684835824606652148] cluster 'zipkin' match for URL '/api/v2/spans'
[Envoy (Epoch 0)] [2020-04-29 12:43:54.678][37][debug][router] [external/envoy/source/common/router/router.cc:614] [C0][S10684835824606652148] router decoding headers:
':method', 'POST'
':path', '/api/v2/spans'
':authority', 'zipkin'
':scheme', 'http'
'content-type', 'application/json'
'x-envoy-internal', 'true'
'x-forwarded-for', '172.16.57.54'
'x-envoy-expected-rq-timeout-ms', '5000'

[Envoy (Epoch 0)] [2020-04-29 12:43:54.678][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:95] creating a new connection
[Envoy (Epoch 0)] [2020-04-29 12:43:54.678][37][debug][client] [external/envoy/source/common/http/codec_client.cc:34] [C423] connecting
[Envoy (Epoch 0)] [2020-04-29 12:43:54.678][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:698] [C423] connecting to 10.100.96.58:9411
[Envoy (Epoch 0)] [2020-04-29 12:43:54.678][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:707] [C423] connection in progress
[Envoy (Epoch 0)] [2020-04-29 12:43:54.678][37][debug][pool] [external/envoy/source/common/http/conn_pool_base.cc:55] queueing request due to no available connections
[Envoy (Epoch 0)] [2020-04-29 12:43:54.680][37][debug][connection] [external/envoy/source/common/network/connection_impl.cc:570] [C423] connected
[Envoy (Epoch 0)] [2020-04-29 12:43:54.680][37][debug][client] [external/envoy/source/common/http/codec_client.cc:72] [C423] connected
[Envoy (Epoch 0)] [2020-04-29 12:43:54.680][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:244] [C423] attaching to next request
[Envoy (Epoch 0)] [2020-04-29 12:43:54.680][37][debug][router] [external/envoy/source/common/router/router.cc:1711] [C0][S10684835824606652148] pool ready
[Envoy (Epoch 0)] [2020-04-29 12:43:54.681][37][debug][router] [external/envoy/source/common/router/router.cc:1115] [C0][S10684835824606652148] upstream headers complete: end_stream=false
[Envoy (Epoch 0)] [2020-04-29 12:43:54.681][37][debug][http] [external/envoy/source/common/http/async_client_impl.cc:95] async http request response headers (end_stream=false):
':status', '400'
'content-type', 'text/plain; charset=utf-8'
'x-content-type-options', 'nosniff'
'date', 'Wed, 29 Apr 2020 12:43:54 GMT'
'content-length', '133'
'x-envoy-upstream-service-time', '2'

[Envoy (Epoch 0)] [2020-04-29 12:43:54.681][37][debug][client] [external/envoy/source/common/http/codec_client.cc:104] [C423] response complete
[Envoy (Epoch 0)] [2020-04-29 12:43:54.681][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:201] [C423] response complete
[Envoy (Epoch 0)] [2020-04-29 12:43:54.681][37][debug][pool] [external/envoy/source/common/http/http1/conn_pool.cc:239] [C423] moving to ready