Skip to content

Instantly share code, notes, and snippets.

@vertexclique

vertexclique/async-api-nuclei-changes-bench.txt

Created January 27, 2024 04:46
Show Gist options
  • Save vertexclique/cd1307d38210bec2d5e3b768502daef0 to your computer and use it in GitHub Desktop.
Save vertexclique/cd1307d38210bec2d5e3b768502daef0 to your computer and use it in GitHub Desktop.
Download ZIP
async-api-nuclei-changes-bench.txt
Raw
async-api-nuclei-changes-bench.txt
exact_buf_write/4.00 KiB
time: [121.39 ns 122.07 ns 122.79 ns]
thrpt: [31.067 GiB/s 31.251 GiB/s 31.424 GiB/s]
change:
time: [-1.6055% -1.0408% -0.4293%] (p = 0.00 < 0.05)
thrpt: [+0.4312% +1.0517% +1.6317%]
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
exact_buf_write/256 KiB time: [71.903 ns 72.184 ns 72.523 ns]
thrpt: [3366.4 GiB/s 3382.2 GiB/s 3395.4 GiB/s]
change:
time: [-37.945% -37.559% -37.162%] (p = 0.00 < 0.05)
thrpt: [+59.140% +60.151% +61.147%]
Performance has improved.
exact_buf_write/4.00 MiB
time: [570.32 ns 573.44 ns 576.82 ns]
thrpt: [6772.1 GiB/s 6811.9 GiB/s 6849.2 GiB/s]
change:
time: [-3.7957% -3.1430% -2.3994%] (p = 0.00 < 0.05)
thrpt: [+2.4584% +3.2450% +3.9455%]
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
exact_buf_write/16.0 MiB
time: [2.1479 µs 2.1595 µs 2.1738 µs]
thrpt: [7187.9 GiB/s 7235.5 GiB/s 7274.6 GiB/s]
change:
time: [-4.7246% -4.1121% -3.4964%] (p = 0.00 < 0.05)
thrpt: [+3.6231% +4.2885% +4.9589%]
Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
4 (4.00%) low mild
5 (5.00%) high mild
3 (3.00%) high severe
Running benches/ops/main.rs (/home/vcq/projects/opendal/target/release/deps/ops-c5a76882c61d23bf)
service_memory_read_full/4.00 KiB
time: [2.7011 µs 2.7149 µs 2.7312 µs]
thrpt: [1.3967 GiB/s 1.4051 GiB/s 1.4123 GiB/s]
change:
time: [-4.1279% -3.4423% -2.7239%] (p = 0.00 < 0.05)
thrpt: [+2.8002% +3.5651% +4.3057%]
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
service_memory_read_full/256 KiB
time: [9.8783 µs 9.9297 µs 9.9860 µs]
thrpt: [24.448 GiB/s 24.587 GiB/s 24.715 GiB/s]
change:
time: [-4.1337% -3.4635% -2.7057%] (p = 0.00 < 0.05)
thrpt: [+2.7810% +3.5878% +4.3120%]
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
service_memory_read_full/4.00 MiB
time: [203.88 µs 204.58 µs 205.29 µs]
thrpt: [19.028 GiB/s 19.094 GiB/s 19.159 GiB/s]
change:
time: [-1.4613% -1.0505% -0.6424%] (p = 0.00 < 0.05)
thrpt: [+0.6466% +1.0616% +1.4830%]
Change within noise threshold.
Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) low mild
8 (8.00%) high mild
1 (1.00%) high severe
service_memory_read_full/16.0 MiB
time: [950.50 µs 957.06 µs 964.57 µs]
thrpt: [16.199 GiB/s 16.326 GiB/s 16.439 GiB/s]
change:
time: [-7.9837% -7.1941% -6.4330%] (p = 0.00 < 0.05)
thrpt: [+6.8753% +7.7518% +8.6764%]
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
service_memory_read_part/4.00 KiB
time: [2.9253 µs 2.9398 µs 2.9558 µs]
thrpt: [1.2906 GiB/s 1.2976 GiB/s 1.3041 GiB/s]
change:
time: [-5.8376% -4.9343% -4.1086%] (p = 0.00 < 0.05)
thrpt: [+4.2847% +5.1904% +6.1995%]
Performance has improved.
service_memory_read_part/256 KiB
time: [12.774 µs 12.871 µs 12.970 µs]
thrpt: [18.824 GiB/s 18.968 GiB/s 19.112 GiB/s]
change:
time: [-3.0060% -2.2959% -1.5857%] (p = 0.00 < 0.05)
thrpt: [+1.6113% +2.3498% +3.0992%]
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
service_memory_read_part/4.00 MiB
time: [301.34 µs 302.04 µs 302.75 µs]
thrpt: [12.903 GiB/s 12.933 GiB/s 12.963 GiB/s]
change:
time: [-1.9226% -1.4828% -1.0880%] (p = 0.00 < 0.05)
thrpt: [+1.1000% +1.5051% +1.9603%]
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking service_memory_read_part/16.0 MiB: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.9s, enable flat sampling, or reduce sample count to 50.
service_memory_read_part/16.0 MiB
time: [1.5625 ms 1.5721 ms 1.5831 ms]
thrpt: [9.8697 GiB/s 9.9387 GiB/s 10.0000 GiB/s]
change:
time: [-8.7864% -7.8923% -7.0182%] (p = 0.00 < 0.05)
thrpt: [+7.5480% +8.5686% +9.6328%]
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
8 (8.00%) high mild
service_memory_read_parallel/1x4.00 KiB
time: [2.8949 µs 2.9169 µs 2.9409 µs]
thrpt: [1.2971 GiB/s 1.3078 GiB/s 1.3177 GiB/s]
change:
time: [-3.3104% -2.3762% -1.4828%] (p = 0.00 < 0.05)
thrpt: [+1.5051% +2.4341% +3.4237%]
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low mild
4 (4.00%) high mild
2 (2.00%) high severe
service_memory_read_parallel/2x4.00 KiB
time: [5.6762 µs 5.7095 µs 5.7431 µs]
thrpt: [1.3284 GiB/s 1.3363 GiB/s 1.3441 GiB/s]
change:
time: [-3.8868% -3.1185% -2.3717%] (p = 0.00 < 0.05)
thrpt: [+2.4293% +3.2189% +4.0439%]
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
service_memory_read_parallel/4x4.00 KiB
time: [11.263 µs 11.335 µs 11.403 µs]
thrpt: [1.3381 GiB/s 1.3462 GiB/s 1.3548 GiB/s]
change:
time: [-3.5892% -2.8081% -2.1128%] (p = 0.00 < 0.05)
thrpt: [+2.1584% +2.8892% +3.7228%]
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
service_memory_read_parallel/8x4.00 KiB
time: [22.180 µs 22.262 µs 22.352 µs]
thrpt: [1.3653 GiB/s 1.3708 GiB/s 1.3759 GiB/s]
change:
time: [-3.9715% -3.0623% -1.7651%] (p = 0.00 < 0.05)
thrpt: [+1.7968% +3.1591% +4.1358%]
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
service_memory_read_parallel/16x4.00 KiB
time: [45.885 µs 46.576 µs 47.254 µs]
thrpt: [1.2916 GiB/s 1.3104 GiB/s 1.3302 GiB/s]
change:
time: [-2.5296% -1.4316% -0.3086%] (p = 0.01 < 0.05)
thrpt: [+0.3095% +1.4524% +2.5952%]
Change within noise threshold.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
service_memory_read_parallel/1x256 KiB
time: [19.855 µs 20.070 µs 20.299 µs]
thrpt: [12.027 GiB/s 12.165 GiB/s 12.296 GiB/s]
change:
time: [+5.4025% +6.7541% +8.0539%] (p = 0.00 < 0.05)
thrpt: [-7.4536% -6.3268% -5.1256%]
Performance has regressed.
service_memory_read_parallel/2x256 KiB
time: [39.571 µs 40.118 µs 40.683 µs]
thrpt: [12.002 GiB/s 12.171 GiB/s 12.339 GiB/s]
change:
time: [+0.0023% +1.3075% +2.6212%] (p = 0.05 > 0.05)
thrpt: [-2.5542% -1.2907% -0.0023%]
No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
service_memory_read_parallel/4x256 KiB
time: [79.497 µs 80.393 µs 81.306 µs]
thrpt: [12.011 GiB/s 12.147 GiB/s 12.284 GiB/s]
change:
time: [-0.3224% +1.4483% +3.1475%] (p = 0.11 > 0.05)
thrpt: [-3.0515% -1.4276% +0.3235%]
No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
service_memory_read_parallel/8x256 KiB
time: [157.16 µs 158.55 µs 160.01 µs]
thrpt: [12.206 GiB/s 12.318 GiB/s 12.427 GiB/s]
change:
time: [+1.1895% +2.2599% +3.3521%] (p = 0.00 < 0.05)
thrpt: [-3.2434% -2.2099% -1.1755%]
Performance has regressed.
service_memory_read_parallel/16x256 KiB
time: [305.43 µs 308.18 µs 311.24 µs]
thrpt: [12.551 GiB/s 12.675 GiB/s 12.789 GiB/s]
change:
time: [-2.9093% -1.6518% -0.4210%] (p = 0.01 < 0.05)
thrpt: [+0.4227% +1.6796% +2.9965%]
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
service_memory_read_parallel/1x4.00 MiB
time: [701.81 µs 706.32 µs 711.38 µs]
thrpt: [5.4911 GiB/s 5.5304 GiB/s 5.5660 GiB/s]
change:
time: [+2.0016% +2.6840% +3.3830%] (p = 0.00 < 0.05)
thrpt: [-3.2723% -2.6139% -1.9623%]
Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
9 (9.00%) high mild
1 (1.00%) high severe
Benchmarking service_memory_read_parallel/2x4.00 MiB: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.4s, enable flat sampling, or reduce sample count to 50.
service_memory_read_parallel/2x4.00 MiB
time: [1.3308 ms 1.3395 ms 1.3499 ms]
thrpt: [5.7876 GiB/s 5.8322 GiB/s 5.8706 GiB/s]
change:
time: [+0.3254% +1.1146% +1.8735%] (p = 0.01 < 0.05)
thrpt: [-1.8391% -1.1023% -0.3243%]
Change within noise threshold.
service_memory_read_parallel/4x4.00 MiB
time: [2.7289 ms 2.7375 ms 2.7463 ms]
thrpt: [5.6894 GiB/s 5.7078 GiB/s 5.7257 GiB/s]
change:
time: [-0.6283% -0.2299% +0.1560%] (p = 0.26 > 0.05)
thrpt: [-0.1558% +0.2304% +0.6323%]
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
service_memory_read_parallel/8x4.00 MiB
time: [5.7133 ms 5.7404 ms 5.7685 ms]
thrpt: [5.4173 GiB/s 5.4439 GiB/s 5.4697 GiB/s]
change:
time: [-0.3378% +0.3082% +0.9436%] (p = 0.34 > 0.05)
thrpt: [-0.9348% -0.3073% +0.3390%]
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
service_memory_read_parallel/16x4.00 MiB
time: [10.818 ms 10.852 ms 10.888 ms]
thrpt: [5.7405 GiB/s 5.7594 GiB/s 5.7773 GiB/s]
change:
time: [-0.9372% -0.5082% -0.0687%] (p = 0.02 < 0.05)
thrpt: [+0.0687% +0.5108% +0.9461%]
Change within noise threshold.
Found 7 outliers among 100 measurements (7.00%)
6 (6.00%) high mild
1 (1.00%) high severe
service_memory_read_parallel/1x16.0 MiB
time: [3.1584 ms 3.1722 ms 3.1867 ms]
thrpt: [4.9032 GiB/s 4.9256 GiB/s 4.9471 GiB/s]
change:
time: [-9.1567% -8.6353% -8.0573%] (p = 0.00 < 0.05)
thrpt: [+8.7634% +9.4515% +10.080%]
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
9 (9.00%) high mild
service_memory_read_parallel/2x16.0 MiB
time: [6.2390 ms 6.2708 ms 6.3046 ms]
thrpt: [4.9567 GiB/s 4.9835 GiB/s 5.0088 GiB/s]
change:
time: [-3.6055% -2.9566% -2.3048%] (p = 0.00 < 0.05)
thrpt: [+2.3592% +3.0467% +3.7404%]
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
service_memory_read_parallel/4x16.0 MiB
time: [12.164 ms 12.216 ms 12.270 ms]
thrpt: [5.0935 GiB/s 5.1161 GiB/s 5.1381 GiB/s]
change:
time: [-5.5282% -4.9723% -4.4207%] (p = 0.00 < 0.05)
thrpt: [+4.6251% +5.2324% +5.8516%]
Performance has improved.
service_memory_read_parallel/8x16.0 MiB
time: [24.770 ms 24.877 ms 24.997 ms]
thrpt: [5.0006 GiB/s 5.0247 GiB/s 5.0464 GiB/s]
change:
time: [-4.0833% -3.4018% -2.7161%] (p = 0.00 < 0.05)
thrpt: [+2.7919% +3.5216% +4.2572%]
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
5 (5.00%) high mild
1 (1.00%) high severe
service_memory_read_parallel/16x16.0 MiB
time: [48.551 ms 48.748 ms 48.952 ms]
thrpt: [5.1070 GiB/s 5.1284 GiB/s 5.1493 GiB/s]
change:
time: [-6.8216% -6.2101% -5.6099%] (p = 0.00 < 0.05)
thrpt: [+5.9433% +6.6212% +7.3210%]
Performance has improved.
service_memory_write_once/4.00 KiB
time: [2.8262 µs 2.8391 µs 2.8533 µs]
thrpt: [1.3369 GiB/s 1.3436 GiB/s 1.3498 GiB/s]
change:
time: [-6.2264% -5.4885% -4.6997%] (p = 0.00 < 0.05)
thrpt: [+4.9315% +5.8073% +6.6399%]
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
service_memory_write_once/256 KiB
time: [11.644 µs 11.774 µs 11.924 µs]
thrpt: [20.475 GiB/s 20.735 GiB/s 20.967 GiB/s]
change:
time: [-2.0807% -0.8044% +0.4954%] (p = 0.23 > 0.05)
thrpt: [-0.4930% +0.8109% +2.1250%]
No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
service_memory_write_once/4.00 MiB
time: [289.71 µs 290.81 µs 292.04 µs]
thrpt: [13.376 GiB/s 13.433 GiB/s 13.483 GiB/s]
change:
time: [-0.4667% +0.1233% +0.7241%] (p = 0.69 > 0.05)
thrpt: [-0.7189% -0.1232% +0.4689%]
No change in performance detected.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking service_memory_write_once/16.0 MiB: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.5s, enable flat sampling, or reduce sample count to 50.
service_memory_write_once/16.0 MiB
time: [1.4748 ms 1.4811 ms 1.4882 ms]
thrpt: [10.499 GiB/s 10.550 GiB/s 10.594 GiB/s]
change:
time: [-5.7692% -5.3405% -4.8352%] (p = 0.00 < 0.05)
thrpt: [+5.0809% +5.6418% +6.1225%]
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
service_memory_write_with_concurrent/1
time: [19.223 ms 19.317 ms 19.434 ms]
thrpt: [4.0201 GiB/s 4.0445 GiB/s 4.0642 GiB/s]
change:
time: [-4.3534% -3.3301% -2.3904%] (p = 0.00 < 0.05)
thrpt: [+2.4490% +3.4448% +4.5515%]
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
service_memory_write_with_concurrent/2
time: [19.646 ms 19.738 ms 19.863 ms]
thrpt: [3.9333 GiB/s 3.9580 GiB/s 3.9767 GiB/s]
change:
time: [-1.3963% -0.8540% -0.1429%] (p = 0.00 < 0.05)
thrpt: [+0.1431% +0.8613% +1.4161%]
Change within noise threshold.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high severe
service_memory_write_with_concurrent/4
time: [19.612 ms 19.713 ms 19.844 ms]
thrpt: [3.9369 GiB/s 3.9631 GiB/s 3.9836 GiB/s]
change:
time: [-2.7599% -1.7144% -0.6727%] (p = 0.00 < 0.05)
thrpt: [+0.6773% +1.7443% +2.8382%]
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
service_memory_write_with_concurrent/8
time: [19.623 ms 19.762 ms 19.941 ms]
thrpt: [3.9177 GiB/s 3.9534 GiB/s 3.9814 GiB/s]
change:
time: [-2.7889% -1.7693% -0.6937%] (p = 0.00 < 0.05)
thrpt: [+0.6985% +1.8012% +2.8689%]
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment