Skip to content

Instantly share code, notes, and snippets.

@irizzant
Last active September 3, 2021 12:11
Show Gist options
  • Save irizzant/bfe93d82b293915fc4ffa7b5edb77773 to your computer and use it in GitHub Desktop.
Save irizzant/bfe93d82b293915fc4ffa7b5edb77773 to your computer and use it in GitHub Desktop.
Linkerd issue 6804
time="2021-09-03T10:50:12Z" level=info msg="running version stable-2.10.2"
[ 0.008202s] INFO ThreadId(01) linkerd2_proxy::rt: Using single-threaded proxy runtime
[ 0.008915s] INFO ThreadId(01) linkerd2_proxy: Admin interface on 0.0.0.0:4191
[ 0.008930s] INFO ThreadId(01) linkerd2_proxy: Inbound interface on 0.0.0.0:4143
[ 0.008934s] INFO ThreadId(01) linkerd2_proxy: Outbound interface on 127.0.0.1:4140
[ 0.008938s] INFO ThreadId(01) linkerd2_proxy: Tap interface on 0.0.0.0:4190
[ 0.008941s] INFO ThreadId(01) linkerd2_proxy: Local identity is thanos-query.monitoring.serviceaccount.identity.linkerd.cluster.local
[ 0.008946s] INFO ThreadId(01) linkerd2_proxy: Identity verified via linkerd-identity-headless.linkerd.svc.cluster.local:8080 (linkerd-identity.linkerd.serviceaccount.identity.linkerd.cluster.local)
[ 0.008950s] INFO ThreadId(01) linkerd2_proxy: Destinations resolved via linkerd-dst-headless.linkerd.svc.cluster.local:8086 (linkerd-destination.linkerd.serviceaccount.identity.linkerd.cluster.local)
[ 0.020715s] INFO ThreadId(02) daemon:identity: linkerd_app: Certified identity: thanos-query.monitoring.serviceaccount.identity.linkerd.cluster.local
[ 4.568871s] INFO ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 4.568890s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 7.568877s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_timeout::failfast: HTTP Logical entering failfast after 3s
[ 7.568920s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Logical service in fail-fast client.addr=10.42.0.86:39946
[ 7.569359s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: HTTP Logical entering failfast after 3s
[ 7.569379s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_timeout::failfast: HTTP Balancer entering failfast after 3s
[ 7.569400s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: HTTP Balancer entering failfast after 3s
[ 7.569427s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Logical service in fail-fast client.addr=10.42.0.86:43718
[ 7.570461s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 9.563068s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: HTTP Logical service has recovered
[ 9.563148s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:43878
[ 9.563480s] INFO ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_timeout::failfast: HTTP Logical service has recovered
[ 9.563537s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:40108
[ 9.566110s] INFO ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 10.571169s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: TCP Logical entering failfast after 3s
[ 10.571308s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 10.571327s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 12.565864s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_timeout::failfast: TCP Logical entering failfast after 3s
[ 12.566008s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 14.563211s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:40306
[ 14.563336s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:44080
[ 19.562062s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:40460
[ 19.562180s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:44234
[ 19.563258s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 19.628113s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 19.628132s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 22.563463s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: TCP Logical entering failfast after 3s
[ 22.563550s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 24.565159s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 24.565599s] INFO ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 26.638933s] INFO ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 27.565363s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: HTTP Logical entering failfast after 3s
[ 27.565391s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: HTTP Balancer entering failfast after 3s
[ 27.565410s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_timeout::failfast: HTTP Logical entering failfast after 3s
[ 27.565428s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Logical service in fail-fast client.addr=10.42.0.86:44630
[ 27.565463s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Logical service in fail-fast client.addr=10.42.0.86:40860
[ 27.566590s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_timeout::failfast: HTTP Balancer entering failfast after 3s
[ 27.566655s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 27.566664s] INFO ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 29.566031s] INFO ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_timeout::failfast: HTTP Logical service has recovered
[ 29.566128s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: HTTP Logical service has recovered
[ 29.566195s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:41026
[ 29.566369s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:44800
[ 30.567273s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: TCP Logical entering failfast after 3s
[ 30.567409s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_timeout::failfast: TCP Logical entering failfast after 3s
[ 30.567491s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 30.567513s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 30.567522s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 30.567531s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 34.563121s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:41178
[ 34.563162s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:44952
[ 34.563968s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 39.564330s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:45180
[ 39.565621s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:41410
[ 39.571180s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_proxy_api_resolve::resolve: No endpoints
[ 42.570968s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: TCP Logical entering failfast after 3s
[ 42.571061s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 44.563039s] WARN ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:45370
[ 44.563267s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:41602
[ 44.563487s] INFO ThreadId(01) linkerd_app_core::serve: Connection closed error=TCP Logical service in fail-fast
[ 49.565010s] INFO ThreadId(01) server{orig_dst=10.43.112.5:10901}: linkerd_timeout::failfast: HTTP Balancer service has recovered
[ 49.565290s] WARN ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_app_core::errors: Failed to proxy request: HTTP Balancer service in fail-fast client.addr=10.42.0.86:41814
[ 54.563148s] INFO ThreadId(01) server{orig_dst=10.43.179.37:10901}: linkerd_timeout::failfast: HTTP Balancer service has recovered
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment