Skip to content

Instantly share code, notes, and snippets.

@Harsh-2002
Created May 9, 2026 06:45
Show Gist options
  • Select an option

  • Save Harsh-2002/a004de85fb404e8c361f5bc8ba72cde1 to your computer and use it in GitHub Desktop.

Select an option

Save Harsh-2002/a004de85fb404e8c361f5bc8ba72cde1 to your computer and use it in GitHub Desktop.
Noema QA extreme/phase-11 20260509-040851Z — log artefacts
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
created: 4/4 workers
4 workers [12 items]
scheduling tests via LoadScheduling
tests/admin_extended/test_profile.py::test_memory_profile_starts[plain-cluster]
tests/admin_extended/test_inspect.py::test_inspect_returns_placement[plain-cluster]
tests/admin_extended/test_profile.py::test_memory_profile_starts[tls-cluster]
tests/admin_extended/test_inspect.py::test_inspect_returns_placement[tls-cluster]
[gw3] [ 8%] PASSED tests/admin_extended/test_profile.py::test_memory_profile_starts[plain-cluster]
[gw1] [ 16%] PASSED tests/admin_extended/test_profile.py::test_memory_profile_starts[tls-cluster]
tests/admin_extended/test_profile.py::test_profile_download[plain-cluster]
tests/admin_extended/test_profile.py::test_profile_download[tls-cluster]
[gw2] [ 25%] PASSED tests/admin_extended/test_inspect.py::test_inspect_returns_placement[plain-cluster]
tests/admin_extended/test_profile.py::test_cpu_profile_starts[plain-cluster]
[gw2] [ 33%] PASSED tests/admin_extended/test_profile.py::test_cpu_profile_starts[plain-cluster]
tests/admin_extended/test_profile.py::test_memory_profile_starts[standalone]
[gw2] [ 41%] PASSED tests/admin_extended/test_profile.py::test_memory_profile_starts[standalone]
tests/admin_extended/test_profile.py::test_profile_download[standalone]
[gw0] [ 50%] PASSED tests/admin_extended/test_inspect.py::test_inspect_returns_placement[tls-cluster]
tests/admin_extended/test_profile.py::test_cpu_profile_starts[tls-cluster]
[gw0] [ 58%] PASSED tests/admin_extended/test_profile.py::test_cpu_profile_starts[tls-cluster]
[gw1] [ 66%] PASSED tests/admin_extended/test_profile.py::test_profile_download[tls-cluster]
tests/admin_extended/test_profile.py::test_cpu_profile_starts[standalone]
[gw3] [ 75%] PASSED tests/admin_extended/test_profile.py::test_profile_download[plain-cluster]
tests/admin_extended/test_inspect.py::test_inspect_returns_placement[standalone]
[gw3] [ 83%] SKIPPED tests/admin_extended/test_inspect.py::test_inspect_returns_placement[standalone]
[gw1] [ 91%] PASSED tests/admin_extended/test_profile.py::test_cpu_profile_starts[standalone]
[gw2] [100%] PASSED tests/admin_extended/test_profile.py::test_profile_download[standalone]
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-admin_extended.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-admin_extended.json
- Generated html report: file:///tmp/noema-qa-extreme-20260509-040851Z/pytest-admin_extended.html -
=========================== short test summary info ============================
SKIPPED [1] tests/admin_extended/test_inspect.py: cluster_only test skipped on standalone
======================== 11 passed, 1 skipped in 10.22s ========================
[bring-up] running preflight
✓ docker 29.3.1
✓ docker compose 5.1.1
✓ dbr network dbr ipam subnets: ['103.165.99.0/24', '10.0.0.0/20', '203.153.55.0/24']
✓ ip collisions no collisions on 10.0.12.65–.73
✓ gh auth github.com
✓ release v0.1.95 v0.1.95 reachable
✓ python packages all required python packages importable
PREFLIGHT OK
[bring-up] binary present: /home/av/noema/qa/binary/noema
[bring-up] issuing certs for tls-cluster
[bring-up] master keys ready
[bring-up] membership files ready
[bring-up] data/conf dirs ready
[bring-up] compose rendered → /home/av/noema/qa/docker/docker-compose.yaml
[bring-up] docker compose up -d --build
Image noema-qa:bookworm Building
Image noema-qa:bookworm Building
Image noema-qa:bookworm Building
Image noema-qa:bookworm Building
Image noema-qa:bookworm Building
Image noema-qa:bookworm Building
Image noema-qa:bookworm Building
Image noema-qa:bookworm Building
Image noema-qa:bookworm Building
#1 [internal] load local bake definitions
#1 reading from stdin 4.28kB done
#1 DONE 0.0s
#2 [noema-tls-4 internal] load build definition from Dockerfile.noema
#2 transferring dockerfile: 1.61kB done
#2 DONE 0.0s
#3 [noema-solo-1 internal] load metadata for docker.io/library/debian:bookworm-slim
#3 DONE 0.4s
#4 [noema-plain-1 internal] load .dockerignore
#4 transferring context: 2B done
#4 DONE 0.0s
#5 [noema-plain-4 1/5] FROM docker.io/library/debian:bookworm-slim@sha256:67b30a61dc87758f0caf819646104f29ecbda97d920aaf5edc834128ac8493d3
#5 DONE 0.0s
#6 [noema-plain-4 internal] load build context
#6 transferring context: 35B done
#6 DONE 0.0s
#7 [noema-plain-4 3/5] RUN mkdir -p /data /conf /usr/local/bin
#7 CACHED
#8 [noema-plain-4 2/5] RUN set -eux; apt-get update; DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends tini ca-certificates iputils-ping iproute2 iptables net-tools curl jq gosu ; rm -rf /var/lib/apt/lists/*
#8 CACHED
#9 [noema-plain-4 4/5] COPY entrypoint.sh /entrypoint.sh
#9 CACHED
#10 [noema-plain-4 5/5] RUN chmod +x /entrypoint.sh
#10 CACHED
#11 [noema-plain-1] exporting to image
#11 exporting layers done
#11 writing image sha256:43632aeb06c11fe17c2df6fcaeddaf35094ced43dcba6ac867d021ea555a8d10 done
#11 naming to docker.io/library/noema-qa:bookworm done
#11 DONE 0.0s
#12 [noema-tls-2] exporting to image
#12 exporting layers done
#12 writing image sha256:074bd94f054f27e727372ad44dc94c68099e5cf2dc311fe1264ef317aed7dd5e done
#12 naming to docker.io/library/noema-qa:bookworm done
#12 DONE 0.0s
#13 [noema-plain-2] exporting to image
#13 exporting layers done
#13 writing image sha256:c3ec231421e4818674dbc4bd9beae36c6e6af7c1683b564fd0aa525216639547 done
#13 naming to docker.io/library/noema-qa:bookworm done
#13 DONE 0.0s
#14 [noema-solo-1] exporting to image
#14 exporting layers done
#14 writing image sha256:cfe393469435879116cd71c1b790048f90a780c9ff3acb393774de78564b4c3a done
#14 naming to docker.io/library/noema-qa:bookworm done
#14 DONE 0.0s
#15 [noema-tls-1] exporting to image
#15 exporting layers done
#15 writing image sha256:e784eea215243cad264eca33900dabbe905641546fd8e9015b0c92328e08e9d3 done
#15 naming to docker.io/library/noema-qa:bookworm done
#15 DONE 0.0s
#16 [noema-tls-4] exporting to image
#16 exporting layers done
#16 writing image sha256:3fceaf04160c5be331e4c2f8299d2319efbb028a46f5e3942466b3577f5c32c6 done
#16 naming to docker.io/library/noema-qa:bookworm done
#16 DONE 0.0s
#17 [noema-plain-4] exporting to image
#17 exporting layers done
#17 writing image sha256:ac572f66040f67853a540e1943639c3594153f1c97182e0b94fd40bc0f24efe2 done
#17 naming to docker.io/library/noema-qa:bookworm 0.0s done
#17 DONE 0.0s
#18 [noema-tls-3] exporting to image
#18 exporting layers done
#18 writing image sha256:bab7e8be7ed4ae35e35bd84b5ff0de401c9616a88bbc5d14f3fcd4edc62d40f8 done
#18 naming to docker.io/library/noema-qa:bookworm done
#18 DONE 0.0s
#19 [noema-plain-3] exporting to image
#19 exporting layers done
#19 writing image sha256:89558423813b2db0e8719576cdb77a9e9c423cde87a3abfefa0f4535c9f68a04 done
#19 naming to docker.io/library/noema-qa:bookworm done
#19 DONE 0.0s
#20 [noema-plain-4] resolving provenance for metadata file
#20 DONE 0.0s
#21 [noema-tls-3] resolving provenance for metadata file
#21 DONE 0.0s
#22 [noema-plain-2] resolving provenance for metadata file
#22 DONE 0.0s
#23 [noema-plain-3] resolving provenance for metadata file
#23 DONE 0.0s
#24 [noema-solo-1] resolving provenance for metadata file
#24 DONE 0.0s
#25 [noema-tls-4] resolving provenance for metadata file
#25 DONE 0.0s
#26 [noema-plain-1] resolving provenance for metadata file
#26 DONE 0.0s
#27 [noema-tls-1] resolving provenance for metadata file
#27 DONE 0.0s
#28 [noema-tls-2] resolving provenance for metadata file
#28 DONE 0.0s
Image noema-qa:bookworm Built
Image noema-qa:bookworm Built
Image noema-qa:bookworm Built
Image noema-qa:bookworm Built
Image noema-qa:bookworm Built
Image noema-qa:bookworm Built
Image noema-qa:bookworm Built
Image noema-qa:bookworm Built
Image noema-qa:bookworm Built
Container noema-plain-3 Recreate
Container noema-tls-1 Recreate
Container noema-solo-1 Recreate
Container noema-tls-2 Recreate
Container noema-plain-4 Recreate
Container noema-tls-3 Recreate
Container noema-plain-1 Recreate
Container noema-tls-4 Recreate
Container noema-plain-2 Recreate
Container noema-tls-3 Recreated
Container noema-plain-2 Recreated
Container noema-plain-3 Recreated
Container noema-solo-1 Recreated
Container noema-tls-4 Recreated
Container noema-tls-1 Recreated
Container noema-tls-2 Recreated
Container noema-plain-4 Recreated
Container noema-plain-1 Recreated
Container noema-plain-2 Starting
Container noema-tls-4 Starting
Container noema-plain-4 Starting
Container noema-plain-1 Starting
Container noema-tls-1 Starting
Container noema-tls-3 Starting
Container noema-tls-2 Starting
Container noema-solo-1 Starting
Container noema-plain-3 Starting
Container noema-tls-2 Started
Container noema-plain-1 Started
Container noema-plain-4 Started
Container noema-plain-2 Started
Container noema-solo-1 Started
Container noema-plain-3 Started
Container noema-tls-3 Started
Container noema-tls-1 Started
Container noema-tls-4 Started
[bring-up] ✓ noema-tls-1 http://10.0.12.65:9001
[bring-up] ✓ noema-tls-2 http://10.0.12.66:9001
[bring-up] ✓ noema-tls-3 http://10.0.12.67:9001
[bring-up] ✓ noema-tls-4 http://10.0.12.68:9001
[bring-up] ✓ noema-plain-1 http://10.0.12.69:9001
[bring-up] ✓ noema-plain-2 http://10.0.12.70:9001
[bring-up] ✓ noema-plain-3 http://10.0.12.71:9001
[bring-up] ✓ noema-plain-4 http://10.0.12.72:9001
[bring-up] ✓ noema-solo-1 http://10.0.12.73:9001
[bring-up] ✓ tls-cluster nodes=4 leader=1 epoch=1
[bring-up] ✓ plain-cluster nodes=4 leader=1 epoch=1
[bring-up] wrote /home/av/noema/qa/state/run.json
[bring-up] bring-up complete.
{
"run_id": "20260509T064558Z",
"results_dir": "/tmp/noema-qa-extreme-20260509-040851Z",
"noema_version": "v0.1.95",
"harness_version": "qa-1.0.0",
"overall_pass": true,
"pytest": {},
"warp": {
"summary": {
"total": 0,
"passed": 0,
"failed": 0,
"known_bugs": 0
},
"results": []
},
"chaos": {
"total": 0,
"recovered": 0,
"data_loss": 0
}
}
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
collecting ... collected 48 items / 39 deselected / 9 selected
tests/integrity/test_bitflip.py::test_single_bitflip_in_data_shard_still_reads[tls-cluster] SKIPPED [ 11%]
tests/integrity/test_bitflip.py::test_bitflip_in_meta_file[tls-cluster] SKIPPED [ 22%]
tests/integrity/test_bitflip.py::test_multiple_bitflips_within_repair_threshold[tls-cluster] SKIPPED [ 33%]
tests/integrity/test_bitflip.py::test_single_bitflip_in_data_shard_still_reads[plain-cluster] SKIPPED [ 44%]
tests/integrity/test_bitflip.py::test_bitflip_in_meta_file[plain-cluster] SKIPPED [ 55%]
tests/integrity/test_bitflip.py::test_multiple_bitflips_within_repair_threshold[plain-cluster] SKIPPED [ 66%]
tests/integrity/test_bitflip.py::test_single_bitflip_in_data_shard_still_reads[standalone] SKIPPED [ 77%]
tests/integrity/test_bitflip.py::test_bitflip_in_meta_file[standalone] SKIPPED [ 88%]
tests/integrity/test_bitflip.py::test_multiple_bitflips_within_repair_threshold[standalone] SKIPPED [100%]
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-integrity-chaos.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-integrity-chaos.json
- Generated html report: file:///tmp/noema-qa-extreme-20260509-040851Z/pytest-integrity-chaos.html -
=========================== short test summary info ============================
SKIPPED [1] tests/integrity/test_bitflip.py:55: no shard file located on noema-tls-2
SKIPPED [2] tests/integrity/test_bitflip.py:73: no nm.meta found
SKIPPED [2] tests/integrity/test_bitflip.py:91: could not flip bits in any shard
SKIPPED [1] tests/integrity/test_bitflip.py:55: no shard file located on noema-plain-2
SKIPPED [3] tests/integrity/test_bitflip.py: cluster_only test skipped on standalone
====================== 9 skipped, 39 deselected in 10.37s ======================
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
created: 4/4 workers
4 workers [39 items]
scheduling tests via LoadScheduling
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-16]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-65535]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-1]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-4096]
[gw2] [ 2%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-4096]
[gw0] [ 5%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-1]
[gw1] [ 7%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-16]
[gw3] [ 10%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-65535]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-4097]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-4095]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-2]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-65536]
[gw1] [ 12%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-4095]
tests/integrity/test_compression_edges.py::test_etag_is_plaintext_md5[tls-cluster]
[gw0] [ 15%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-2]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-1048576]
[gw3] [ 17%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-65536]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-2]
[gw2] [ 20%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-4097]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-65537]
[gw1] [ 23%] PASSED tests/integrity/test_compression_edges.py::test_etag_is_plaintext_md5[tls-cluster]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-1]
[gw2] [ 25%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-65537]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-1048575]
[gw3] [ 28%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-2]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-16]
[gw1] [ 30%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-1]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-4095]
[gw0] [ 33%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-1048576]
tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-1048577]
[gw3] [ 35%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-16]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-4097]
[gw2] [ 38%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-1048575]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-4096]
[gw1] [ 41%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-4095]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-65535]
[gw3] [ 43%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-4097]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-65537]
[gw0] [ 46%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[tls-cluster-1048577]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-65536]
[gw1] [ 48%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-65535]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-1048576]
[gw2] [ 51%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-4096]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-1048575]
[gw3] [ 53%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-65537]
tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-1048577]
[gw0] [ 56%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-65536]
tests/integrity/test_compression_edges.py::test_etag_is_plaintext_md5[plain-cluster]
[gw2] [ 58%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-1048575]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-2]
[gw0] [ 61%] PASSED tests/integrity/test_compression_edges.py::test_etag_is_plaintext_md5[plain-cluster]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-4095]
[gw1] [ 64%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-1048576]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-1]
[gw2] [ 66%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-2]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-4096]
[gw3] [ 69%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[plain-cluster-1048577]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-16]
[gw0] [ 71%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-4095]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-4097]
[gw2] [ 74%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-4096]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-65536]
[gw1] [ 76%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-1]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-65535]
[gw3] [ 79%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-16]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-65537]
[gw0] [ 82%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-4097]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-1048575]
[gw2] [ 84%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-65536]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-1048576]
[gw1] [ 87%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-65535]
tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-1048577]
[gw3] [ 89%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-65537]
tests/integrity/test_compression_edges.py::test_etag_is_plaintext_md5[standalone]
[gw3] [ 92%] PASSED tests/integrity/test_compression_edges.py::test_etag_is_plaintext_md5[standalone]
[gw0] [ 94%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-1048575]
[gw2] [ 97%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-1048576]
[gw1] [100%] PASSED tests/integrity/test_compression_edges.py::test_roundtrip_size[standalone-1048577]
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-integrity-fast.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-integrity-fast.json
- Generated html report: file:///tmp/noema-qa-extreme-20260509-040851Z/pytest-integrity-fast.html -
============================== 39 passed in 9.88s ==============================
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
collecting ... collected 27 items / 24 deselected / 3 selected
tests/operational/test_restart_persistence.py::test_state_survives_full_cluster_restart[tls-cluster] PASSED [ 33%]
tests/operational/test_restart_persistence.py::test_state_survives_full_cluster_restart[plain-cluster] PASSED [ 66%]
tests/operational/test_restart_persistence.py::test_state_survives_full_cluster_restart[standalone] SKIPPED [100%]
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-operational-chaos.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-operational-chaos.json
- Generated html report: file:///tmp/noema-qa-extreme-20260509-040851Z/pytest-operational-chaos.html -
=========================== short test summary info ============================
SKIPPED [1] tests/operational/test_restart_persistence.py: cluster_only test skipped on standalone
=========== 2 passed, 1 skipped, 24 deselected in 181.27s (0:03:01) ============
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
created: 4/4 workers
4 workers [24 items]
scheduling tests via LoadScheduling
tests/operational/test_objectlock_compliance.py::test_compliance_delete_rejected[tls-cluster]
tests/operational/test_config_reload.py::test_unknown_subsystem[tls-cluster]
tests/operational/test_config_reload.py::test_healing_max_concurrent[tls-cluster]
tests/operational/test_config_reload.py::test_compression_level_roundtrip[tls-cluster]
[gw2] [ 4%] PASSED tests/operational/test_config_reload.py::test_unknown_subsystem[tls-cluster]
[gw0] [ 8%] PASSED tests/operational/test_config_reload.py::test_compression_level_roundtrip[tls-cluster]
tests/operational/test_config_reload.py::test_help_endpoint[tls-cluster]
tests/operational/test_config_reload.py::test_compression_enabled_toggle[tls-cluster]
[gw2] [ 12%] PASSED tests/operational/test_config_reload.py::test_help_endpoint[tls-cluster]
[gw1] [ 16%] PASSED tests/operational/test_config_reload.py::test_healing_max_concurrent[tls-cluster]
tests/operational/test_config_reload.py::test_compression_level_roundtrip[plain-cluster]
tests/operational/test_config_reload.py::test_invalid_value_rejected[tls-cluster]
[gw0] [ 20%] PASSED tests/operational/test_config_reload.py::test_compression_enabled_toggle[tls-cluster]
tests/operational/test_config_reload.py::test_compression_enabled_toggle[plain-cluster]
[gw2] [ 25%] PASSED tests/operational/test_config_reload.py::test_compression_level_roundtrip[plain-cluster]
tests/operational/test_config_reload.py::test_healing_max_concurrent[plain-cluster]
[gw1] [ 29%] PASSED tests/operational/test_config_reload.py::test_invalid_value_rejected[tls-cluster]
tests/operational/test_config_reload.py::test_invalid_value_rejected[plain-cluster]
[gw0] [ 33%] PASSED tests/operational/test_config_reload.py::test_compression_enabled_toggle[plain-cluster]
tests/operational/test_config_reload.py::test_unknown_subsystem[plain-cluster]
[gw2] [ 37%] PASSED tests/operational/test_config_reload.py::test_healing_max_concurrent[plain-cluster]
tests/operational/test_config_reload.py::test_help_endpoint[plain-cluster]
[gw1] [ 41%] PASSED tests/operational/test_config_reload.py::test_invalid_value_rejected[plain-cluster]
tests/operational/test_objectlock_compliance.py::test_compliance_delete_rejected[plain-cluster]
[gw0] [ 45%] PASSED tests/operational/test_config_reload.py::test_unknown_subsystem[plain-cluster]
tests/operational/test_objectlock_compliance.py::test_governance_bypass_works_compliance_does_not[plain-cluster]
[gw2] [ 50%] PASSED tests/operational/test_config_reload.py::test_help_endpoint[plain-cluster]
tests/operational/test_config_reload.py::test_compression_level_roundtrip[standalone]
[gw2] [ 54%] PASSED tests/operational/test_config_reload.py::test_compression_level_roundtrip[standalone]
tests/operational/test_config_reload.py::test_invalid_value_rejected[standalone]
[gw2] [ 58%] PASSED tests/operational/test_config_reload.py::test_invalid_value_rejected[standalone]
tests/operational/test_config_reload.py::test_unknown_subsystem[standalone]
[gw2] [ 62%] PASSED tests/operational/test_config_reload.py::test_unknown_subsystem[standalone]
tests/operational/test_config_reload.py::test_help_endpoint[standalone]
[gw2] [ 66%] PASSED tests/operational/test_config_reload.py::test_help_endpoint[standalone]
tests/operational/test_objectlock_compliance.py::test_compliance_delete_rejected[standalone]
[gw1] [ 70%] PASSED tests/operational/test_objectlock_compliance.py::test_compliance_delete_rejected[plain-cluster]
tests/operational/test_config_reload.py::test_compression_enabled_toggle[standalone]
[gw3] [ 75%] PASSED tests/operational/test_objectlock_compliance.py::test_compliance_delete_rejected[tls-cluster]
tests/operational/test_objectlock_compliance.py::test_governance_bypass_works_compliance_does_not[tls-cluster]
[gw0] [ 79%] PASSED tests/operational/test_objectlock_compliance.py::test_governance_bypass_works_compliance_does_not[plain-cluster]
tests/operational/test_config_reload.py::test_healing_max_concurrent[standalone]
[gw1] [ 83%] PASSED tests/operational/test_config_reload.py::test_compression_enabled_toggle[standalone]
[gw0] [ 87%] PASSED tests/operational/test_config_reload.py::test_healing_max_concurrent[standalone]
[gw2] [ 91%] PASSED tests/operational/test_objectlock_compliance.py::test_compliance_delete_rejected[standalone]
tests/operational/test_objectlock_compliance.py::test_governance_bypass_works_compliance_does_not[standalone]
[gw2] [ 95%] PASSED tests/operational/test_objectlock_compliance.py::test_governance_bypass_works_compliance_does_not[standalone]
[gw3] [100%] PASSED tests/operational/test_objectlock_compliance.py::test_governance_bypass_works_compliance_does_not[tls-cluster]
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-operational-fast.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-operational-fast.json
- Generated html report: file:///tmp/noema-qa-extreme-20260509-040851Z/pytest-operational-fast.html -
============================== 24 passed in 4.67s ==============================
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
created: 4/4 workers
4 workers [0 items]
scheduling tests via LoadScheduling
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-protocol.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-protocol.json
- Generated html report: file:///tmp/noema-qa-extreme-20260509-040851Z/pytest-protocol.html -
============================ no tests ran in 2.04s =============================
[bring-up] ✓ noema-solo-1 http://10.0.12.73:9001
[bring-up] ✓ tls-cluster nodes=4 leader=1 epoch=1
[bring-up] ✓ plain-cluster nodes=4 leader=1 epoch=1
[bring-up] wrote /home/av/noema/qa/state/run.json
[bring-up] bring-up complete.
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
collecting ... collected 6 items
tests/replication/test_cross_cluster.py::test_add_remove_replication_site[tls-cluster] SKIPPED [ 16%]
tests/replication/test_cross_cluster.py::test_replication_status_endpoint[tls-cluster] SKIPPED [ 33%]
tests/replication/test_cross_cluster.py::test_add_remove_replication_site[plain-cluster] PASSED [ 50%]
tests/replication/test_cross_cluster.py::test_replication_status_endpoint[plain-cluster] PASSED [ 66%]
tests/replication/test_cross_cluster.py::test_add_remove_replication_site[standalone] SKIPPED [ 83%]
tests/replication/test_cross_cluster.py::test_replication_status_endpoint[standalone] SKIPPED [100%]
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-replication.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-replication.json
- Generated html report: file:///tmp/noema-qa-extreme-20260509-040851Z/pytest-replication.html -
=========================== short test summary info ============================
SKIPPED [1] tests/replication/test_cross_cluster.py:45: test runs only on plain-cluster
SKIPPED [1] tests/replication/test_cross_cluster.py:57: Skipped
SKIPPED [2] tests/replication/test_cross_cluster.py: cluster_only test skipped on standalone
========================= 2 passed, 4 skipped in 0.48s =========================
2026-05-09T04:08:51Z | ===== EXTREME PHASE: 0 — pre-flight bring-up =====
2026-05-09T04:09:27Z | ===== EXTREME PHASE: A — security & IAM enforcement =====
2026-05-09T04:09:27Z | pytest -m 'security' -n 4 tests/security
2026-05-09T04:09:36Z | ===== EXTREME PHASE: B — data integrity (incl. bit-flip) =====
2026-05-09T04:09:36Z | pytest -m 'integrity and not chaos' -n 4 tests/integrity
2026-05-09T04:09:48Z | pytest -m 'integrity and chaos' -n 0 tests/integrity
2026-05-09T04:10:00Z | ===== EXTREME PHASE: C — scale (special keys, many objects) =====
2026-05-09T04:10:00Z | pytest -m 'scale and not slow' -n 4 tests/scale
2026-05-09T04:10:11Z | pytest -m 'scale and slow' -n 0 tests/scale
2026-05-09T04:41:26Z | ===== EXTREME PHASE: D — operational (config reload, restart, COMPLIANCE) =====
2026-05-09T04:41:26Z | pytest -m 'operational and not chaos' -n 4 tests/operational
2026-05-09T04:41:33Z | pytest -m 'operational and chaos' -n 0 tests/operational
2026-05-09T04:44:36Z | ===== EXTREME PHASE: E — cross-cluster replication =====
2026-05-09T04:44:36Z | pytest -m 'replication and not chaos' -n 0 tests/replication
2026-05-09T04:44:38Z | ===== EXTREME PHASE: F — S3 protocol edge cases =====
2026-05-09T04:44:38Z | pytest -m 'protocol or admin_extended' -n 4 tests/protocol tests/admin_extended
2026-05-09T04:44:42Z | ===== EXTREME PHASE: G — admin extended =====
2026-05-09T04:44:42Z | pytest -m 'admin' -n 4 tests/admin_extended
2026-05-09T04:44:54Z | ===== EXTREME PHASE: H — time / clock invariants =====
2026-05-09T04:44:54Z | pytest -m 'time' -n 4 tests/time
2026-05-09T04:44:58Z | ===== EXTREME PHASE: I — 1-hour memory/FD soak (plain cluster only) =====
2026-05-09T06:45:09Z | ===== EXTREME PHASE: post-extreme bring-up (recover from any leftover chaos) =====
2026-05-09T06:45:57Z | ===== EXTREME PHASE: aggregate extreme results =====
run_id: 20260509T064558Z
overall_pass: True
results_dir: /tmp/noema-qa-extreme-20260509-040851Z
warp: total=0 passed=0 failed=0 known_bugs=0
chaos: total=0 recovered=0 data_loss=0
2026-05-09T06:45:58Z | ===== EXTREME PHASE: bundle logs into gist =====
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
created: 4/4 workers
4 workers [36 items]
scheduling tests via LoadScheduling
tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-ascii-plain]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-with=equals&and-amp]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-emoji-\U0001f680-\U0001f389.bin]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-with+plus+chars]
[gw3] [ 2%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-emoji-\U0001f680-\U0001f389.bin]
[gw2] [ 5%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-with=equals&and-amp]
[gw0] [ 8%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-ascii-plain]
[gw1] [ 11%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-with+plus+chars]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-with-tab\there]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-\u4e2d\u6587\u6587\u4ef6\u540d.bin]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-with spaces and dots.txt]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-with%percent]
[gw3] [ 13%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-with-tab\there]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-unicode-na\xefve-caf\xe9]
[gw2] [ 16%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-\u4e2d\u6587\u6587\u4ef6\u540d.bin]
tests/scale/test_special_keys.py::test_long_key_1023[tls-cluster]
[gw0] [ 19%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-with spaces and dots.txt]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-ascii-plain]
[gw1] [ 22%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-with%percent]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-with+plus+chars]
[gw3] [ 25%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-unicode-na\xefve-caf\xe9]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-a/b/c/deep]
[gw2] [ 27%] PASSED tests/scale/test_special_keys.py::test_long_key_1023[tls-cluster]
tests/scale/test_special_keys.py::test_long_key_1025_rejected_or_works[tls-cluster]
[gw3] [ 30%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[tls-cluster-a/b/c/deep]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-with=equals&and-amp]
[gw2] [ 33%] PASSED tests/scale/test_special_keys.py::test_long_key_1025_rejected_or_works[tls-cluster]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-\u4e2d\u6587\u6587\u4ef6\u540d.bin]
[gw0] [ 36%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-ascii-plain]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-with spaces and dots.txt]
[gw1] [ 38%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-with+plus+chars]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-with%percent]
[gw1] [ 41%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-with%percent]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-a/b/c/deep]
[gw0] [ 44%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-with spaces and dots.txt]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-unicode-na\xefve-caf\xe9]
[gw3] [ 47%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-with=equals&and-amp]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-emoji-\U0001f680-\U0001f389.bin]
[gw2] [ 50%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-\u4e2d\u6587\u6587\u4ef6\u540d.bin]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-with-tab\there]
[gw1] [ 52%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-a/b/c/deep]
tests/scale/test_special_keys.py::test_long_key_1023[plain-cluster]
[gw0] [ 55%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-unicode-na\xefve-caf\xe9]
tests/scale/test_special_keys.py::test_long_key_1025_rejected_or_works[plain-cluster]
[gw3] [ 58%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-emoji-\U0001f680-\U0001f389.bin]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-ascii-plain]
[gw2] [ 61%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[plain-cluster-with-tab\there]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-with spaces and dots.txt]
[gw0] [ 63%] PASSED tests/scale/test_special_keys.py::test_long_key_1025_rejected_or_works[plain-cluster]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-with%percent]
[gw1] [ 66%] PASSED tests/scale/test_special_keys.py::test_long_key_1023[plain-cluster]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-with+plus+chars]
[gw3] [ 69%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-ascii-plain]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-with=equals&and-amp]
[gw2] [ 72%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-with spaces and dots.txt]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-\u4e2d\u6587\u6587\u4ef6\u540d.bin]
[gw0] [ 75%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-with%percent]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-emoji-\U0001f680-\U0001f389.bin]
[gw1] [ 77%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-with+plus+chars]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-with-tab\there]
[gw3] [ 80%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-with=equals&and-amp]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-unicode-na\xefve-caf\xe9]
[gw2] [ 83%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-\u4e2d\u6587\u6587\u4ef6\u540d.bin]
tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-a/b/c/deep]
[gw0] [ 86%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-emoji-\U0001f680-\U0001f389.bin]
tests/scale/test_special_keys.py::test_long_key_1023[standalone]
[gw1] [ 88%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-with-tab\there]
tests/scale/test_special_keys.py::test_long_key_1025_rejected_or_works[standalone]
[gw3] [ 91%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-unicode-na\xefve-caf\xe9]
[gw2] [ 94%] PASSED tests/scale/test_special_keys.py::test_roundtrip_special_keys[standalone-a/b/c/deep]
[gw1] [ 97%] PASSED tests/scale/test_special_keys.py::test_long_key_1025_rejected_or_works[standalone]
[gw0] [100%] PASSED tests/scale/test_special_keys.py::test_long_key_1023[standalone]
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-scale-fast.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-scale-fast.json
- Generated html report: file:///tmp/noema-qa-extreme-20260509-040851Z/pytest-scale-fast.html -
============================== 36 passed in 9.02s ==============================
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
collecting ... collected 48 items / 36 deselected / 12 selected
tests/scale/test_many_objects.py::test_500_objects_list_pagination[tls-cluster] PASSED [ 8%]
tests/scale/test_many_objects.py::test_500_objects_prefix_query[tls-cluster] PASSED [ 16%]
tests/scale/test_many_objects.py::test_10k_objects_listing[tls-cluster] +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Captured stdout ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
put 1000/10000 in 72.8s
put 2000/10000 in 198.3s
put 3000/10000 in 354.6s
put 4000/10000 in 525.1s
put 5000/10000 in 731.8s
put 6000/10000 in 960.4s
put 7000/10000 in 1257.8s
put 8000/10000 in 1606.3s
~~~~~~~~~~~~~~~ Stack of Thread-1 (run_server) (137019770754752) ~~~~~~~~~~~~~~~
File "/usr/lib/python3.12/threading.py", line 1030, in _bootstrap
self._bootstrap_inner()
File "/usr/lib/python3.12/threading.py", line 1073, in _bootstrap_inner
self.run()
File "/usr/lib/python3.12/threading.py", line 1010, in run
self._target(*self._args, **self._kwargs)
File "/home/av/.local/lib/python3.12/site-packages/pytest_rerunfailures.py", line 466, in run_server
conn, _ = self.sock.accept()
File "/usr/lib/python3.12/socket.py", line 295, in accept
fd, addr = self._accept()
~~~~~~~~~~~~~~~~~~~~ Stack of MainThread (137019822219392) ~~~~~~~~~~~~~~~~~~~~~
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/usr/lib/python3/dist-packages/pytest/__main__.py", line 5, in <module>
raise SystemExit(pytest.console_main())
File "/usr/lib/python3/dist-packages/_pytest/config/__init__.py", line 192, in console_main
code = main()
File "/usr/lib/python3/dist-packages/_pytest/config/__init__.py", line 169, in main
ret: Union[ExitCode, int] = config.hook.pytest_cmdline_main(
File "/usr/lib/python3/dist-packages/pluggy/_hooks.py", line 501, in __call__
return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
File "/usr/lib/python3/dist-packages/pluggy/_manager.py", line 119, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "/usr/lib/python3/dist-packages/pluggy/_callers.py", line 102, in _multicall
res = hook_impl.function(*args)
File "/usr/lib/python3/dist-packages/_pytest/main.py", line 318, in pytest_cmdline_main
return wrap_session(config, _main)
File "/usr/lib/python3/dist-packages/_pytest/main.py", line 271, in wrap_session
session.exitstatus = doit(config, session) or 0
File "/usr/lib/python3/dist-packages/_pytest/main.py", line 325, in _main
config.hook.pytest_runtestloop(session=session)
File "/usr/lib/python3/dist-packages/pluggy/_hooks.py", line 501, in __call__
return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
File "/usr/lib/python3/dist-packages/pluggy/_manager.py", line 119, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "/usr/lib/python3/dist-packages/pluggy/_callers.py", line 102, in _multicall
res = hook_impl.function(*args)
File "/usr/lib/python3/dist-packages/_pytest/main.py", line 350, in pytest_runtestloop
item.config.hook.pytest_runtest_protocol(item=item, nextitem=nextitem)
File "/usr/lib/python3/dist-packages/pluggy/_hooks.py", line 501, in __call__
return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
File "/usr/lib/python3/dist-packages/pluggy/_manager.py", line 119, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "/usr/lib/python3/dist-packages/pluggy/_callers.py", line 102, in _multicall
res = hook_impl.function(*args)
File "/home/av/.local/lib/python3.12/site-packages/pytest_rerunfailures.py", line 593, in pytest_runtest_protocol
reports = runtestprotocol(item, nextitem=nextitem, log=False)
File "/usr/lib/python3/dist-packages/_pytest/runner.py", line 133, in runtestprotocol
reports.append(call_and_report(item, "call", log))
File "/usr/lib/python3/dist-packages/_pytest/runner.py", line 222, in call_and_report
call = call_runtest_hook(item, when, **kwds)
File "/usr/lib/python3/dist-packages/_pytest/runner.py", line 261, in call_runtest_hook
return CallInfo.from_call(
File "/usr/lib/python3/dist-packages/_pytest/runner.py", line 341, in from_call
result: Optional[TResult] = func()
File "/usr/lib/python3/dist-packages/_pytest/runner.py", line 262, in <lambda>
lambda: ihook(item=item, **kwds), when=when, reraise=reraise
File "/usr/lib/python3/dist-packages/pluggy/_hooks.py", line 501, in __call__
return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
File "/usr/lib/python3/dist-packages/pluggy/_manager.py", line 119, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "/usr/lib/python3/dist-packages/pluggy/_callers.py", line 102, in _multicall
res = hook_impl.function(*args)
File "/usr/lib/python3/dist-packages/_pytest/runner.py", line 169, in pytest_runtest_call
item.runtest()
File "/usr/lib/python3/dist-packages/_pytest/python.py", line 1792, in runtest
self.ihook.pytest_pyfunc_call(pyfuncitem=self)
File "/usr/lib/python3/dist-packages/pluggy/_hooks.py", line 501, in __call__
return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
File "/usr/lib/python3/dist-packages/pluggy/_manager.py", line 119, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "/usr/lib/python3/dist-packages/pluggy/_callers.py", line 102, in _multicall
res = hook_impl.function(*args)
File "/usr/lib/python3/dist-packages/_pytest/python.py", line 194, in pytest_pyfunc_call
result = testfunction(**testargs)
File "/home/av/noema/qa/tests/scale/test_many_objects.py", line 50, in test_10k_objects_listing
s3.client.put_object(Bucket=bucket, Key=f"big/{i:05d}", Body=b"")
File "/usr/lib/python3/dist-packages/botocore/client.py", line 553, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/lib/python3/dist-packages/botocore/client.py", line 989, in _make_api_call
http, parsed_response = self._make_request(
File "/usr/lib/python3/dist-packages/botocore/client.py", line 1015, in _make_request
return self._endpoint.make_request(operation_model, request_dict)
File "/usr/lib/python3/dist-packages/botocore/endpoint.py", line 119, in make_request
return self._send_request(request_dict, operation_model)
File "/usr/lib/python3/dist-packages/botocore/endpoint.py", line 199, in _send_request
success_response, exception = self._get_response(
File "/usr/lib/python3/dist-packages/botocore/endpoint.py", line 241, in _get_response
success_response, exception = self._do_get_response(
File "/usr/lib/python3/dist-packages/botocore/endpoint.py", line 281, in _do_get_response
http_response = self._send(request)
File "/usr/lib/python3/dist-packages/botocore/endpoint.py", line 377, in _send
return self.http_session.send(request)
File "/usr/lib/python3/dist-packages/botocore/httpsession.py", line 464, in send
urllib_response = conn.urlopen(
File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 791, in urlopen
response = self._make_request(
File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 537, in _make_request
response = conn.getresponse()
File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 461, in getresponse
httplib_response = super().getresponse()
File "/usr/lib/python3.12/http/client.py", line 1448, in getresponse
response.begin()
File "/usr/lib/python3.12/http/client.py", line 336, in begin
version, status, reason = self._read_status()
File "/usr/lib/python3.12/http/client.py", line 297, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/lib/python3.12/socket.py", line 707, in readinto
return self._sock.recv_into(b)
File "/usr/lib/python3.12/ssl.py", line 1252, in recv_into
return self.read(nbytes, buffer)
File "/usr/lib/python3.12/ssl.py", line 1104, in read
return self._sslobj.read(len, buffer)
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
created: 4/4 workers
4 workers [15 items]
scheduling tests via LoadScheduling
tests/security/test_iam_enforcement.py::test_readonly_policy_denies_put[tls-cluster]
tests/security/test_iam_enforcement.py::test_explicit_deny_overrides_allow[tls-cluster]
tests/security/test_iam_enforcement.py::test_writeonly_policy_denies_get[plain-cluster]
tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[tls-cluster]
[gw3] [ 6%] PASSED tests/security/test_iam_enforcement.py::test_writeonly_policy_denies_get[plain-cluster]
tests/security/test_iam_enforcement.py::test_explicit_deny_overrides_allow[plain-cluster]
[gw0] [ 13%] PASSED tests/security/test_iam_enforcement.py::test_readonly_policy_denies_put[tls-cluster]
tests/security/test_iam_enforcement.py::test_writeonly_policy_denies_get[tls-cluster]
[gw1] [ 20%] PASSED tests/security/test_iam_enforcement.py::test_explicit_deny_overrides_allow[tls-cluster]
tests/security/test_iam_enforcement.py::test_user_with_no_policy_denied_by_default[tls-cluster]
[gw1] [ 26%] PASSED tests/security/test_iam_enforcement.py::test_user_with_no_policy_denied_by_default[tls-cluster]
tests/security/test_iam_enforcement.py::test_readonly_policy_denies_put[standalone]
[gw3] [ 33%] PASSED tests/security/test_iam_enforcement.py::test_explicit_deny_overrides_allow[plain-cluster]
tests/security/test_iam_enforcement.py::test_user_with_no_policy_denied_by_default[plain-cluster]
[gw0] [ 40%] PASSED tests/security/test_iam_enforcement.py::test_writeonly_policy_denies_get[tls-cluster]
tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[plain-cluster]
[gw3] [ 46%] PASSED tests/security/test_iam_enforcement.py::test_user_with_no_policy_denied_by_default[plain-cluster]
tests/security/test_iam_enforcement.py::test_explicit_deny_overrides_allow[standalone]
[gw1] [ 53%] PASSED tests/security/test_iam_enforcement.py::test_readonly_policy_denies_put[standalone]
tests/security/test_iam_enforcement.py::test_writeonly_policy_denies_get[standalone]
[gw3] [ 60%] PASSED tests/security/test_iam_enforcement.py::test_explicit_deny_overrides_allow[standalone]
tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[standalone]
[gw2] [ 66%] RERUN tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[tls-cluster]
tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[tls-cluster]
[gw1] [ 73%] PASSED tests/security/test_iam_enforcement.py::test_writeonly_policy_denies_get[standalone]
[gw2] [ 73%] FAILED tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[tls-cluster]
tests/security/test_iam_enforcement.py::test_readonly_policy_denies_put[plain-cluster]
[gw2] [ 80%] PASSED tests/security/test_iam_enforcement.py::test_readonly_policy_denies_put[plain-cluster]
[gw0] [ 86%] RERUN tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[plain-cluster]
tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[plain-cluster]
[gw0] [ 86%] FAILED tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[plain-cluster]
tests/security/test_iam_enforcement.py::test_user_with_no_policy_denied_by_default[standalone]
[gw0] [ 93%] PASSED tests/security/test_iam_enforcement.py::test_user_with_no_policy_denied_by_default[standalone]
[gw3] [100%] RERUN tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[standalone]
tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[standalone]
[gw3] [100%] FAILED tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[standalone]
=================================== FAILURES ===================================
_____________ test_disabled_user_cannot_authenticate[tls-cluster] ______________
[gw2] linux -- Python 3.12.3 /usr/bin/python3
tests/security/test_iam_enforcement.py:134: in test_disabled_user_cannot_authenticate
pytest.fail("disabled user shouldn't be able to list buckets")
E Failed: disabled user shouldn't be able to list buckets
____________ test_disabled_user_cannot_authenticate[plain-cluster] _____________
[gw0] linux -- Python 3.12.3 /usr/bin/python3
tests/security/test_iam_enforcement.py:134: in test_disabled_user_cannot_authenticate
pytest.fail("disabled user shouldn't be able to list buckets")
E Failed: disabled user shouldn't be able to list buckets
______________ test_disabled_user_cannot_authenticate[standalone] ______________
[gw3] linux -- Python 3.12.3 /usr/bin/python3
tests/security/test_iam_enforcement.py:134: in test_disabled_user_cannot_authenticate
pytest.fail("disabled user shouldn't be able to list buckets")
E Failed: disabled user shouldn't be able to list buckets
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-security.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-security.json
- Generated html report: file:///tmp/noema-qa-extreme-20260509-040851Z/pytest-security.html -
=========================== short test summary info ============================
FAILED tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[tls-cluster]
FAILED tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[plain-cluster]
FAILED tests/security/test_iam_enforcement.py::test_disabled_user_cannot_authenticate[standalone]
==================== 3 failed, 12 passed, 3 rerun in 7.48s =====================
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
collecting ... collected 1 item
tests/soak/test_memory_fd_soak.py::test_one_hour_soak[plain-cluster] RERUN [100%]
tests/soak/test_memory_fd_soak.py::test_one_hour_soak[plain-cluster] PASSED [100%]
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-soak.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-soak.json
=================== 1 passed, 1 rerun in 7209.74s (2:00:09) ====================
run_id: 20260509T064558Z
overall_pass: True
results_dir: /tmp/noema-qa-extreme-20260509-040851Z
warp: total=0 passed=0 failed=0 known_bugs=0
chaos: total=0 recovered=0 data_loss=0
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-7.4.4, pluggy-1.4.0 -- /usr/bin/python3
cachedir: .pytest_cache
metadata: {'Python': '3.12.3', 'Platform': 'Linux-6.8.0-52-generic-x86_64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.4.0'}, 'Plugins': {'timeout': '2.4.0', 'metadata': '3.1.1', 'xdist': '3.8.0', 'anyio': '4.13.0', 'rerunfailures': '16.1', 'json-report': '1.5.0', 'html': '4.2.0'}}
rootdir: /home/av/noema/qa
configfile: pytest.ini
plugins: timeout-2.4.0, metadata-3.1.1, xdist-3.8.0, anyio-4.13.0, rerunfailures-16.1, json-report-1.5.0, html-4.2.0
timeout: 120.0s
timeout method: thread
timeout func_only: False
created: 4/4 workers
4 workers [0 items]
scheduling tests via LoadScheduling
- generated xml file: /tmp/noema-qa-extreme-20260509-040851Z/pytest-time.junit.xml -
--------------------------------- JSON report ----------------------------------
report saved to: /tmp/noema-qa-extreme-20260509-040851Z/pytest-time.json
- Generated html report: file:///tmp/noema-qa-extreme-20260509-040851Z/pytest-time.html -
============================ no tests ran in 2.02s =============================
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment