prow-checker.py

#!/usr/bin/python3

import urllib.request

# url =
# 'https://storage.googleapis.com/istio-prow/logs/integ-distroless-k8s-tests_istio_postsubmit/1418/build-log.txt'submit/1418/build-log.txt'


def download_url(run: int, suite='integ-distroless-k8s-tests_istio_postsubmit'):
    return f'https://storage.googleapis.com/istio-prow/logs/{suite}/{run}/build-log.txt'


def check_tests(start, end: int,
                suite='integ-distroless-k8s-tests_istio_postsubmit'):
    for i in range(start, end):
        if i % 50 == 0:
            print(f'test checking progress, {i}')
        url = download_url(i, suite=suite)
        try:
            f = urllib.request.urlopen(url)
            result = ''
            for l in f.readlines():
                if 'expected failed' in str(l):
                    result += '\n' + str(l)
            if result != '':
                print(f'Checking suite {suite}, run {i}\n{result}')
        except urllib.error.URLError as e:
            print(f'fail to send request to {suite}, run {i}\n')


# check_tests(1100, 1400)
check_tests(1100, 1400, suite='integ-security-k8s-tests_istio_postsubmit')

distroless resuilt(comment out runs)
Checking suite integ-distroless-k8s-tests_istio_postsubmit, run 1258

b' TestReachability/beta-mtls-partial-automtls/naked->http://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->tcp://multiversion:tcp: checker.go:57: timeout while waiting (last error: naked to multiversion:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: naked to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://multiversion:grpc: checker.go:57: timeout while waiting (last error: naked to multiversion:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://a:http: checker.go:57: timeout while waiting (last error: naked to a:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://a:http: checker.go:57: timeout while waiting (last error: naked to a:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: b to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: b to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->ws://headless:http: checker.go:57: timeout while waiting (last error: b to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->http://headless:http: checker.go:57: timeout while waiting (last error: b to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: a to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: a to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->ws://headless:http: checker.go:57: timeout while waiting (last error: a to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->http://headless:http: checker.go:57: timeout while waiting (last error: a to headless:http using http: expected failed, actually success)\n'
Checking suite integ-distroless-k8s-tests_istio_postsubmit, run 1259

b' TestReachability/beta-mtls-partial-automtls/naked->tcp://multiversion:tcp: checker.go:57: timeout while waiting (last error: naked to multiversion:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://multiversion:grpc: checker.go:57: timeout while waiting (last error: naked to multiversion:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: naked to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://a:grpc: checker.go:57: timeout while waiting (last error: naked to a:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: b to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: b to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: a to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->ws://headless:http: checker.go:57: timeout while waiting (last error: b to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->http://headless:http: checker.go:57: timeout while waiting (last error: b to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->http://headless:http: checker.go:57: timeout while waiting (last error: a to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->ws://headless:http: checker.go:57: timeout while waiting (last error: a to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: a to headless:tcp using tcp: expected failed, actually success)\n'
Checking suite integ-distroless-k8s-tests_istio_postsubmit, run 1279

b' TestReachability/beta-mtls-partial-automtls/a->ws://headless:http: checker.go:57: timeout while waiting (last error: a to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: a to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://a:http: checker.go:57: timeout while waiting (last error: naked to a:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: b to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->http://headless:http: checker.go:57: timeout while waiting (last error: b to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->ws://headless:http: checker.go:57: timeout while waiting (last error: b to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://multiversion:grpc: checker.go:57: timeout while waiting (last error: naked to multiversion:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: naked to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://a:grpc: checker.go:57: timeout while waiting (last error: naked to a:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://a:http: checker.go:57: timeout while waiting (last error: naked to a:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: a to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->http://headless:http: checker.go:57: timeout while waiting (last error: a to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: b to headless:grpc using grpc: expected failed, actually success)\n'
fail to send request to integ-distroless-k8s-tests_istio_postsubmit, run 1305

Checking suite integ-distroless-k8s-tests_istio_postsubmit, run 1306

b' TestReachability/beta-mtls-partial-automtls/a->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: a to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->http://headless:http: checker.go:57: timeout while waiting (last error: a to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->ws://headless:http: checker.go:57: timeout while waiting (last error: a to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: b to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: b to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: a to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://a:http: checker.go:57: timeout while waiting (last error: naked to a:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://a:http: checker.go:57: timeout while waiting (last error: naked to a:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->ws://headless:http: checker.go:57: timeout while waiting (last error: b to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->http://headless:http: checker.go:57: timeout while waiting (last error: b to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: naked to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using http: expected failed, actually success)\n'
Checking suite integ-distroless-k8s-tests_istio_postsubmit, run 1319

b' TestReachability/beta-mtls-partial-automtls/a->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: a to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: naked to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://a:http: checker.go:57: timeout while waiting (last error: naked to a:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: a to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->http://headless:http: checker.go:57: timeout while waiting (last error: a to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/a->ws://headless:http: checker.go:57: timeout while waiting (last error: a to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: b to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://a:http: checker.go:57: timeout while waiting (last error: naked to a:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: b to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->ws://headless:http: checker.go:57: timeout while waiting (last error: b to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/b->http://headless:http: checker.go:57: timeout while waiting (last error: b to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using http: expected failed, actually success)\n'
Checking suite integ-distroless-k8s-tests_istio_postsubmit, run 1379

b' TestReachability/beta-mtls-partial-automtls/naked->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: naked to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://headless:grpc: checker.go:57: timeout while waiting (last error: naked to headless:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://multiversion:grpc: checker.go:57: timeout while waiting (last error: naked to multiversion:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->tcp://a:tcp: checker.go:57: timeout while waiting (last error: naked to a:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://a:grpc: checker.go:57: timeout while waiting (last error: naked to a:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using http: expected failed, actually success)\n'
Checking suite integ-distroless-k8s-tests_istio_postsubmit, run 1380

b' TestReachability/beta-mtls-partial-automtls/naked->ws://a:http: checker.go:57: timeout while waiting (last error: naked to a:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->tcp://multiversion:tcp: checker.go:57: timeout while waiting (last error: naked to multiversion:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using http: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://multiversion:http: checker.go:57: timeout while waiting (last error: naked to multiversion:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->grpc://multiversion:grpc: checker.go:57: timeout while waiting (last error: naked to multiversion:grpc using grpc: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->tcp://headless:tcp: checker.go:57: timeout while waiting (last error: naked to headless:tcp using tcp: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->ws://headless:http: checker.go:57: timeout while waiting (last error: naked to headless:http using ws: expected failed, actually success)\n'
b' TestReachability/beta-mtls-partial-automtls/naked->http://a:http: checker.go:57: timeout while waiting (last error: naked to a:http using http: expected failed, actually success)\n'
Checking suite integ-distroless-k8s-tests_istio_postsubmit, run 1395

b' TestReachability/automtls-partial-sidecar-dr-mutual/a->http://multiversion:http/vlegacy: checker.go:57: timeout while waiting (last error: a to multiversion:http using http: expected failed, actually success)\n'

normal test suite runs
test checking progress, 1100
fail to send request to integ-security-k8s-tests_istio_postsubmit, run 1121

test checking progress, 1150
test checking progress, 1200
test checking progress, 1250
test checking progress, 1300
test checking progress, 1350