Skip to content

Instantly share code, notes, and snippets.

@benwtrent

benwtrent/rallyrun0.txt

Last active November 18, 2022 23:42
Show Gist options
  • Save benwtrent/cc9718bf8cb6d353cee37964472f98df to your computer and use it in GitHub Desktop.
Save benwtrent/cc9718bf8cb6d353cee37964472f98df to your computer and use it in GitHub Desktop.
Download ZIP
Rally runs with new Lucene build
Raw
rallyrun0.txt
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Metric | Task | Baseline | Contender | Diff | Unit | Diff % |
|--------------------------------------------------------------:|---------------------------------------------:|---------------:|---------------:|-------------:|-------:|---------:|
| Cumulative indexing time of primary shards | | 16.0366 | 14.846 | -1.1906 | min | -7.42% |
| Min cumulative indexing time across primary shard | | 8.00595 | 7.40728 | -0.59867 | min | -7.48% |
| Median cumulative indexing time across primary shard | | 8.0183 | 7.423 | -0.5953 | min | -7.42% |
| Max cumulative indexing time across primary shard | | 8.03065 | 7.43872 | -0.59193 | min | -7.37% |
| Cumulative indexing throttle time of primary shards | | 0 | 0 | 0 | min | 0.00% |
| Min cumulative indexing throttle time across primary shard | | 0 | 0 | 0 | min | 0.00% |
| Median cumulative indexing throttle time across primary shard | | 0 | 0 | 0 | min | 0.00% |
| Max cumulative indexing throttle time across primary shard | | 0 | 0 | 0 | min | 0.00% |
| Cumulative merge time of primary shards | | 24.8244 | 24.3702 | -0.45422 | min | -1.83% |
| Cumulative merge count of primary shards | | 14 | 16 | 2 | | +14.29% |
| Min cumulative merge time across primary shard | | 12.303 | 12.0664 | -0.23657 | min | -1.92% |
| Median cumulative merge time across primary shard | | 12.4122 | 12.1851 | -0.22711 | min | -1.83% |
| Max cumulative merge time across primary shard | | 12.5214 | 12.3038 | -0.21765 | min | -1.74% |
| Cumulative merge throttle time of primary shards | | 1.55007 | 1.53053 | -0.01953 | min | -1.26% |
| Min cumulative merge throttle time across primary shard | | 0.774817 | 0.756867 | -0.01795 | min | -2.32% |
| Median cumulative merge throttle time across primary shard | | 0.775033 | 0.765267 | -0.00977 | min | -1.26% |
| Max cumulative merge throttle time across primary shard | | 0.77525 | 0.773667 | -0.00158 | min | -0.20% |
| Cumulative refresh time of primary shards | | 0.108683 | 0.14815 | 0.03947 | min | +36.31% |
| Cumulative refresh count of primary shards | | 181 | 185 | 4 | | +2.21% |
| Min cumulative refresh time across primary shard | | 0.053 | 0.07375 | 0.02075 | min | +39.15% |
| Median cumulative refresh time across primary shard | | 0.0543417 | 0.074075 | 0.01973 | min | +36.31% |
| Max cumulative refresh time across primary shard | | 0.0556833 | 0.0744 | 0.01872 | min | +33.61% |
| Cumulative flush time of primary shards | | 0.28345 | 0.274817 | -0.00863 | min | -3.05% |
| Cumulative flush count of primary shards | | 12 | 12 | 0 | | 0.00% |
| Min cumulative flush time across primary shard | | 0.14045 | 0.136283 | -0.00417 | min | -2.97% |
| Median cumulative flush time across primary shard | | 0.141725 | 0.137408 | -0.00432 | min | -3.05% |
| Max cumulative flush time across primary shard | | 0.143 | 0.138533 | -0.00447 | min | -3.12% |
| Total Young Gen GC time | | 1.733 | 2.438 | 0.705 | s | +40.68% |
| Total Young Gen GC count | | 74 | 71 | -3 | | -4.05% |
| Total Old Gen GC time | | 0 | 0 | 0 | s | 0.00% |
| Total Old Gen GC count | | 0 | 0 | 0 | | 0.00% |
| Store size | | 1.54645 | 1.13518 | -0.41127 | GB | -26.59% |
| Translog size | | 1.02445e-07 | 1.02445e-07 | 0 | GB | 0.00% |
| Heap used for segments | | 0 | 0 | 0 | MB | 0.00% |
| Heap used for doc values | | 0 | 0 | 0 | MB | 0.00% |
| Heap used for terms | | 0 | 0 | 0 | MB | 0.00% |
| Heap used for norms | | 0 | 0 | 0 | MB | 0.00% |
| Heap used for points | | 0 | 0 | 0 | MB | 0.00% |
| Heap used for stored fields | | 0 | 0 | 0 | MB | 0.00% |
| Segment count | | 2 | 2 | 0 | | 0.00% |
| Total Ingest Pipeline count | | 0 | 0 | 0 | | 0.00% |
| Total Ingest Pipeline time | | 0 | 0 | 0 | ms | 0.00% |
| Total Ingest Pipeline failed | | 0 | 0 | 0 | | 0.00% |
| Min Throughput | index-append | 4281.13 | 4679.89 | 398.759 | docs/s | +9.31% |
| Mean Throughput | index-append | 4919.07 | 5353.02 | 433.946 | docs/s | +8.82% |
| Median Throughput | index-append | 4628.54 | 5138.05 | 509.516 | docs/s | +11.01% |
| Max Throughput | index-append | 7447.98 | 7603.54 | 155.564 | docs/s | +2.09% |
| 50th percentile latency | index-append | 1323.42 | 1184.21 | -139.209 | ms | -10.52% |
| 90th percentile latency | index-append | 1534.02 | 1409.66 | -124.352 | ms | -8.11% |
| 99th percentile latency | index-append | 1623.53 | 1627.48 | 3.95389 | ms | +0.24% |
| 100th percentile latency | index-append | 1677.1 | 1830.38 | 153.274 | ms | +9.14% |
| 50th percentile service time | index-append | 1323.42 | 1184.21 | -139.209 | ms | -10.52% |
| 90th percentile service time | index-append | 1534.02 | 1409.66 | -124.352 | ms | -8.11% |
| 99th percentile service time | index-append | 1623.53 | 1627.48 | 3.95389 | ms | +0.24% |
| 100th percentile service time | index-append | 1677.1 | 1830.38 | 153.274 | ms | +9.14% |
| error rate | index-append | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | refresh-after-index | 40.3279 | 21.9629 | -18.365 | ops/s | -45.54% |
| Mean Throughput | refresh-after-index | 40.3279 | 21.9629 | -18.365 | ops/s | -45.54% |
| Median Throughput | refresh-after-index | 40.3279 | 21.9629 | -18.365 | ops/s | -45.54% |
| Max Throughput | refresh-after-index | 40.3279 | 21.9629 | -18.365 | ops/s | -45.54% |
| 100th percentile latency | refresh-after-index | 23.5835 | 43.9871 | 20.4035 | ms | +86.52% |
| 100th percentile service time | refresh-after-index | 23.5835 | 43.9871 | 20.4035 | ms | +86.52% |
| error rate | refresh-after-index | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | index-update-concurrent-with-searches | 8285.75 | 7617.95 | -667.796 | docs/s | -8.06% |
| Mean Throughput | index-update-concurrent-with-searches | 8853.13 | 8557.36 | -295.771 | docs/s | -3.34% |
| Median Throughput | index-update-concurrent-with-searches | 8775.8 | 8608.82 | -166.979 | docs/s | -1.90% |
| Max Throughput | index-update-concurrent-with-searches | 9650.72 | 9542.58 | -108.137 | docs/s | -1.12% |
| 50th percentile latency | index-update-concurrent-with-searches | 609.059 | 598.501 | -10.558 | ms | -1.73% |
| 90th percentile latency | index-update-concurrent-with-searches | 700.267 | 944.161 | 243.894 | ms | +34.83% |
| 100th percentile latency | index-update-concurrent-with-searches | 752.983 | 1511.32 | 758.334 | ms | +100.71% |
| 50th percentile service time | index-update-concurrent-with-searches | 609.059 | 598.501 | -10.558 | ms | -1.73% |
| 90th percentile service time | index-update-concurrent-with-searches | 700.267 | 944.161 | 243.894 | ms | +34.83% |
| 100th percentile service time | index-update-concurrent-with-searches | 752.983 | 1511.32 | 758.334 | ms | +100.71% |
| error rate | index-update-concurrent-with-searches | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | knn-search-100-1000-concurrent-with-indexing | 15.1196 | 14.6284 | -0.49113 | ops/s | -3.25% |
| Mean Throughput | knn-search-100-1000-concurrent-with-indexing | 16.3739 | 16.7272 | 0.35323 | ops/s | +2.16% |
| Median Throughput | knn-search-100-1000-concurrent-with-indexing | 16.3053 | 16.9221 | 0.61685 | ops/s | +3.78% |
| Max Throughput | knn-search-100-1000-concurrent-with-indexing | 17.758 | 18.5675 | 0.80952 | ops/s | +4.56% |
| 50th percentile latency | knn-search-100-1000-concurrent-with-indexing | 67.5937 | 60.617 | -6.97671 | ms | -10.32% |
| 90th percentile latency | knn-search-100-1000-concurrent-with-indexing | 83.2838 | 83.0081 | -0.27568 | ms | -0.33% |
| 99th percentile latency | knn-search-100-1000-concurrent-with-indexing | 99.0369 | 294.156 | 195.12 | ms | +197.02% |
| 100th percentile latency | knn-search-100-1000-concurrent-with-indexing | 141.794 | 390.996 | 249.202 | ms | +175.75% |
| 50th percentile service time | knn-search-100-1000-concurrent-with-indexing | 67.5937 | 60.617 | -6.97671 | ms | -10.32% |
| 90th percentile service time | knn-search-100-1000-concurrent-with-indexing | 83.2838 | 83.0081 | -0.27568 | ms | -0.33% |
| 99th percentile service time | knn-search-100-1000-concurrent-with-indexing | 99.0369 | 294.156 | 195.12 | ms | +197.02% |
| 100th percentile service time | knn-search-100-1000-concurrent-with-indexing | 141.794 | 390.996 | 249.202 | ms | +175.75% |
| error rate | knn-search-100-1000-concurrent-with-indexing | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | refresh-after-update | 331.408 | 233.432 | -97.9765 | ops/s | -29.56% |
| Mean Throughput | refresh-after-update | 331.408 | 233.432 | -97.9765 | ops/s | -29.56% |
| Median Throughput | refresh-after-update | 331.408 | 233.432 | -97.9765 | ops/s | -29.56% |
| Max Throughput | refresh-after-update | 331.408 | 233.432 | -97.9765 | ops/s | -29.56% |
| 100th percentile latency | refresh-after-update | 2.83408 | 4.01258 | 1.1785 | ms | +41.58% |
| 100th percentile service time | refresh-after-update | 2.83408 | 4.01258 | 1.1785 | ms | +41.58% |
| error rate | refresh-after-update | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | force-merge | 0.000794907 | 0.000830708 | 4e-05 | ops/s | +4.50% |
| Mean Throughput | force-merge | 0.000794907 | 0.000830708 | 4e-05 | ops/s | +4.50% |
| Median Throughput | force-merge | 0.000794907 | 0.000830708 | 4e-05 | ops/s | +4.50% |
| Max Throughput | force-merge | 0.000794907 | 0.000830708 | 4e-05 | ops/s | +4.50% |
| 100th percentile latency | force-merge | 1.25801e+06 | 1.20379e+06 | -54217 | ms | -4.31% |
| 100th percentile service time | force-merge | 1.25801e+06 | 1.20379e+06 | -54217 | ms | -4.31% |
| error rate | force-merge | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | knn-search-10-100 | 35.9679 | 128.637 | 92.6686 | ops/s | +257.64% |
| Mean Throughput | knn-search-10-100 | 119.182 | 181.932 | 62.7507 | ops/s | +52.65% |
| Median Throughput | knn-search-10-100 | 118.987 | 181.932 | 62.9449 | ops/s | +52.90% |
| Max Throughput | knn-search-10-100 | 202.59 | 235.228 | 32.6385 | ops/s | +16.11% |
| 50th percentile latency | knn-search-10-100 | 1.81169 | 1.65548 | -0.15621 | ms | -8.62% |
| 90th percentile latency | knn-search-10-100 | 3.00174 | 2.05825 | -0.94349 | ms | -31.43% |
| 99th percentile latency | knn-search-10-100 | 5.2916 | 2.45111 | -2.84049 | ms | -53.68% |
| 99.9th percentile latency | knn-search-10-100 | 6.26335 | 3.35547 | -2.90788 | ms | -46.43% |
| 100th percentile latency | knn-search-10-100 | 7.02746 | 3.82146 | -3.206 | ms | -45.62% |
| 50th percentile service time | knn-search-10-100 | 1.81169 | 1.65548 | -0.15621 | ms | -8.62% |
| 90th percentile service time | knn-search-10-100 | 3.00174 | 2.05825 | -0.94349 | ms | -31.43% |
| 99th percentile service time | knn-search-10-100 | 5.2916 | 2.45111 | -2.84049 | ms | -53.68% |
| 99.9th percentile service time | knn-search-10-100 | 6.26335 | 3.35547 | -2.90788 | ms | -46.43% |
| 100th percentile service time | knn-search-10-100 | 7.02746 | 3.82146 | -3.206 | ms | -45.62% |
| error rate | knn-search-10-100 | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | knn-search-100-1000 | 158.876 | 185.289 | 26.4125 | ops/s | +16.62% |
| Mean Throughput | knn-search-100-1000 | 172.811 | 189.89 | 17.0799 | ops/s | +9.88% |
| Median Throughput | knn-search-100-1000 | 175.902 | 190.934 | 15.032 | ops/s | +8.55% |
| Max Throughput | knn-search-100-1000 | 177.38 | 191.202 | 13.8211 | ops/s | +7.79% |
| 50th percentile latency | knn-search-100-1000 | 5.31683 | 5.04515 | -0.27169 | ms | -5.11% |
| 90th percentile latency | knn-search-100-1000 | 6.93401 | 6.50627 | -0.42775 | ms | -6.17% |
| 99th percentile latency | knn-search-100-1000 | 8.07856 | 7.32741 | -0.75115 | ms | -9.30% |
| 99.9th percentile latency | knn-search-100-1000 | 8.68925 | 7.70481 | -0.98443 | ms | -11.33% |
| 100th percentile latency | knn-search-100-1000 | 15.0955 | 8.26754 | -6.82792 | ms | -45.23% |
| 50th percentile service time | knn-search-100-1000 | 5.31683 | 5.04515 | -0.27169 | ms | -5.11% |
| 90th percentile service time | knn-search-100-1000 | 6.93401 | 6.50627 | -0.42775 | ms | -6.17% |
| 99th percentile service time | knn-search-100-1000 | 8.07856 | 7.32741 | -0.75115 | ms | -9.30% |
| 99.9th percentile service time | knn-search-100-1000 | 8.68925 | 7.70481 | -0.98443 | ms | -11.33% |
| 100th percentile service time | knn-search-100-1000 | 15.0955 | 8.26754 | -6.82792 | ms | -45.23% |
| error rate | knn-search-100-1000 | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | script-score-query | 5.39448 | 5.42629 | 0.03181 | ops/s | +0.59% |
| Mean Throughput | script-score-query | 5.45028 | 5.47275 | 0.02247 | ops/s | +0.41% |
| Median Throughput | script-score-query | 5.45306 | 5.4801 | 0.02704 | ops/s | +0.50% |
| Max Throughput | script-score-query | 5.46338 | 5.48732 | 0.02394 | ops/s | +0.44% |
| 50th percentile latency | script-score-query | 181.511 | 180.806 | -0.70508 | ms | -0.39% |
| 90th percentile latency | script-score-query | 184.022 | 181.598 | -2.42353 | ms | -1.32% |
| 99th percentile latency | script-score-query | 202.434 | 203.325 | 0.89071 | ms | +0.44% |
| 99.9th percentile latency | script-score-query | 223.05 | 253.469 | 30.419 | ms | +13.64% |
| 100th percentile latency | script-score-query | 232.609 | 259.076 | 26.4678 | ms | +11.38% |
| 50th percentile service time | script-score-query | 181.511 | 180.806 | -0.70508 | ms | -0.39% |
| 90th percentile service time | script-score-query | 184.022 | 181.598 | -2.42353 | ms | -1.32% |
| 99th percentile service time | script-score-query | 202.434 | 203.325 | 0.89071 | ms | +0.44% |
| 99.9th percentile service time | script-score-query | 223.05 | 253.469 | 30.419 | ms | +13.64% |
| 100th percentile service time | script-score-query | 232.609 | 259.076 | 26.4678 | ms | +11.38% |
| error rate | script-score-query | 0 | 0 | 0 | % | 0.00% |
Raw
rallyrun1.txt
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Metric | Task | Baseline | Contender | Diff | Unit | Diff % |
|--------------------------------------------------------------:|---------------------------------------------:|---------------:|---------------:|-------------:|-------:|----------:|
| Cumulative indexing time of primary shards | | 16.0366 | 14.5531 | -1.48352 | min | -9.25% |
| Min cumulative indexing time across primary shard | | 8.00595 | 7.26497 | -0.74098 | min | -9.26% |
| Median cumulative indexing time across primary shard | | 8.0183 | 7.27654 | -0.74176 | min | -9.25% |
| Max cumulative indexing time across primary shard | | 8.03065 | 7.28812 | -0.74253 | min | -9.25% |
| Cumulative indexing throttle time of primary shards | | 0 | 0 | 0 | min | 0.00% |
| Min cumulative indexing throttle time across primary shard | | 0 | 0 | 0 | min | 0.00% |
| Median cumulative indexing throttle time across primary shard | | 0 | 0 | 0 | min | 0.00% |
| Max cumulative indexing throttle time across primary shard | | 0 | 0 | 0 | min | 0.00% |
| Cumulative merge time of primary shards | | 24.8244 | 23.5998 | -1.2246 | min | -4.93% |
| Cumulative merge count of primary shards | | 14 | 14 | 0 | | 0.00% |
| Min cumulative merge time across primary shard | | 12.303 | 11.7086 | -0.5944 | min | -4.83% |
| Median cumulative merge time across primary shard | | 12.4122 | 11.7999 | -0.6123 | min | -4.93% |
| Max cumulative merge time across primary shard | | 12.5214 | 11.8912 | -0.6302 | min | -5.03% |
| Cumulative merge throttle time of primary shards | | 1.55007 | 1.60665 | 0.05658 | min | +3.65% |
| Min cumulative merge throttle time across primary shard | | 0.774817 | 0.802083 | 0.02727 | min | +3.52% |
| Median cumulative merge throttle time across primary shard | | 0.775033 | 0.803325 | 0.02829 | min | +3.65% |
| Max cumulative merge throttle time across primary shard | | 0.77525 | 0.804567 | 0.02932 | min | +3.78% |
| Cumulative refresh time of primary shards | | 0.108683 | 0.0923 | -0.01638 | min | -15.07% |
| Cumulative refresh count of primary shards | | 181 | 174 | -7 | | -3.87% |
| Min cumulative refresh time across primary shard | | 0.053 | 0.0433667 | -0.00963 | min | -18.18% |
| Median cumulative refresh time across primary shard | | 0.0543417 | 0.04615 | -0.00819 | min | -15.07% |
| Max cumulative refresh time across primary shard | | 0.0556833 | 0.0489333 | -0.00675 | min | -12.12% |
| Cumulative flush time of primary shards | | 0.28345 | 0.267667 | -0.01578 | min | -5.57% |
| Cumulative flush count of primary shards | | 12 | 12 | 0 | | 0.00% |
| Min cumulative flush time across primary shard | | 0.14045 | 0.133283 | -0.00717 | min | -5.10% |
| Median cumulative flush time across primary shard | | 0.141725 | 0.133833 | -0.00789 | min | -5.57% |
| Max cumulative flush time across primary shard | | 0.143 | 0.134383 | -0.00862 | min | -6.03% |
| Total Young Gen GC time | | 1.733 | 1.532 | -0.201 | s | -11.60% |
| Total Young Gen GC count | | 74 | 69 | -5 | | -6.76% |
| Total Old Gen GC time | | 0 | 0 | 0 | s | 0.00% |
| Total Old Gen GC count | | 0 | 0 | 0 | | 0.00% |
| Store size | | 1.54645 | 1.09141 | -0.45505 | GB | -29.43% |
| Translog size | | 1.02445e-07 | 1.02445e-07 | 0 | GB | 0.00% |
| Heap used for segments | | 0 | 0 | 0 | MB | 0.00% |
| Heap used for doc values | | 0 | 0 | 0 | MB | 0.00% |
| Heap used for terms | | 0 | 0 | 0 | MB | 0.00% |
| Heap used for norms | | 0 | 0 | 0 | MB | 0.00% |
| Heap used for points | | 0 | 0 | 0 | MB | 0.00% |
| Heap used for stored fields | | 0 | 0 | 0 | MB | 0.00% |
| Segment count | | 2 | 2 | 0 | | 0.00% |
| Total Ingest Pipeline count | | 0 | 0 | 0 | | 0.00% |
| Total Ingest Pipeline time | | 0 | 0 | 0 | ms | 0.00% |
| Total Ingest Pipeline failed | | 0 | 0 | 0 | | 0.00% |
| Min Throughput | index-append | 4281.13 | 4731.86 | 450.724 | docs/s | +10.53% |
| Mean Throughput | index-append | 4919.07 | 5435.47 | 516.401 | docs/s | +10.50% |
| Median Throughput | index-append | 4628.54 | 5188.78 | 560.24 | docs/s | +12.10% |
| Max Throughput | index-append | 7447.98 | 8000.79 | 552.808 | docs/s | +7.42% |
| 50th percentile latency | index-append | 1323.42 | 1197.73 | -125.684 | ms | -9.50% |
| 90th percentile latency | index-append | 1534.02 | 1393.3 | -140.714 | ms | -9.17% |
| 99th percentile latency | index-append | 1623.53 | 1449.64 | -173.893 | ms | -10.71% |
| 100th percentile latency | index-append | 1677.1 | 1498.59 | -178.508 | ms | -10.64% |
| 50th percentile service time | index-append | 1323.42 | 1197.73 | -125.684 | ms | -9.50% |
| 90th percentile service time | index-append | 1534.02 | 1393.3 | -140.714 | ms | -9.17% |
| 99th percentile service time | index-append | 1623.53 | 1449.64 | -173.893 | ms | -10.71% |
| 100th percentile service time | index-append | 1677.1 | 1498.59 | -178.508 | ms | -10.64% |
| error rate | index-append | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | refresh-after-index | 40.3279 | 25.5545 | -14.7735 | ops/s | -36.63% |
| Mean Throughput | refresh-after-index | 40.3279 | 25.5545 | -14.7735 | ops/s | -36.63% |
| Median Throughput | refresh-after-index | 40.3279 | 25.5545 | -14.7735 | ops/s | -36.63% |
| Max Throughput | refresh-after-index | 40.3279 | 25.5545 | -14.7735 | ops/s | -36.63% |
| 100th percentile latency | refresh-after-index | 23.5835 | 37.4973 | 13.9138 | ms | +59.00% |
| 100th percentile service time | refresh-after-index | 23.5835 | 37.4973 | 13.9138 | ms | +59.00% |
| error rate | refresh-after-index | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | index-update-concurrent-with-searches | 8285.75 | 8634.57 | 348.823 | docs/s | +4.21% |
| Mean Throughput | index-update-concurrent-with-searches | 8853.13 | 9096.04 | 242.917 | docs/s | +2.74% |
| Median Throughput | index-update-concurrent-with-searches | 8775.8 | 8951.82 | 176.016 | docs/s | +2.01% |
| Max Throughput | index-update-concurrent-with-searches | 9650.72 | 9910.86 | 260.142 | docs/s | +2.70% |
| 50th percentile latency | index-update-concurrent-with-searches | 609.059 | 588.708 | -20.3508 | ms | -3.34% |
| 90th percentile latency | index-update-concurrent-with-searches | 700.267 | 648.672 | -51.595 | ms | -7.37% |
| 100th percentile latency | index-update-concurrent-with-searches | 752.983 | 822.421 | 69.4376 | ms | +9.22% |
| 50th percentile service time | index-update-concurrent-with-searches | 609.059 | 588.708 | -20.3508 | ms | -3.34% |
| 90th percentile service time | index-update-concurrent-with-searches | 700.267 | 648.672 | -51.595 | ms | -7.37% |
| 100th percentile service time | index-update-concurrent-with-searches | 752.983 | 822.421 | 69.4376 | ms | +9.22% |
| error rate | index-update-concurrent-with-searches | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | knn-search-100-1000-concurrent-with-indexing | 15.1196 | 16.9211 | 1.80151 | ops/s | +11.92% |
| Mean Throughput | knn-search-100-1000-concurrent-with-indexing | 16.3739 | 18.3428 | 1.96881 | ops/s | +12.02% |
| Median Throughput | knn-search-100-1000-concurrent-with-indexing | 16.3053 | 17.9826 | 1.67735 | ops/s | +10.29% |
| Max Throughput | knn-search-100-1000-concurrent-with-indexing | 17.758 | 20.1961 | 2.43812 | ops/s | +13.73% |
| 50th percentile latency | knn-search-100-1000-concurrent-with-indexing | 67.5937 | 60.558 | -7.03571 | ms | -10.41% |
| 90th percentile latency | knn-search-100-1000-concurrent-with-indexing | 83.2838 | 74.0084 | -9.27544 | ms | -11.14% |
| 99th percentile latency | knn-search-100-1000-concurrent-with-indexing | 99.0369 | 88.2936 | -10.7432 | ms | -10.85% |
| 100th percentile latency | knn-search-100-1000-concurrent-with-indexing | 141.794 | 157.091 | 15.2968 | ms | +10.79% |
| 50th percentile service time | knn-search-100-1000-concurrent-with-indexing | 67.5937 | 60.558 | -7.03571 | ms | -10.41% |
| 90th percentile service time | knn-search-100-1000-concurrent-with-indexing | 83.2838 | 74.0084 | -9.27544 | ms | -11.14% |
| 99th percentile service time | knn-search-100-1000-concurrent-with-indexing | 99.0369 | 88.2936 | -10.7432 | ms | -10.85% |
| 100th percentile service time | knn-search-100-1000-concurrent-with-indexing | 141.794 | 157.091 | 15.2968 | ms | +10.79% |
| error rate | knn-search-100-1000-concurrent-with-indexing | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | refresh-after-update | 331.408 | 71.061 | -260.347 | ops/s | -78.56% |
| Mean Throughput | refresh-after-update | 331.408 | 71.061 | -260.347 | ops/s | -78.56% |
| Median Throughput | refresh-after-update | 331.408 | 71.061 | -260.347 | ops/s | -78.56% |
| Max Throughput | refresh-after-update | 331.408 | 71.061 | -260.347 | ops/s | -78.56% |
| 100th percentile latency | refresh-after-update | 2.83408 | 12.507 | 9.67292 | ms | +341.31% |
| 100th percentile service time | refresh-after-update | 2.83408 | 12.507 | 9.67292 | ms | +341.31% |
| error rate | refresh-after-update | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | force-merge | 0.000794907 | 0.000839073 | 4e-05 | ops/s | +5.56% |
| Mean Throughput | force-merge | 0.000794907 | 0.000839073 | 4e-05 | ops/s | +5.56% |
| Median Throughput | force-merge | 0.000794907 | 0.000839073 | 4e-05 | ops/s | +5.56% |
| Max Throughput | force-merge | 0.000794907 | 0.000839073 | 4e-05 | ops/s | +5.56% |
| 100th percentile latency | force-merge | 1.25801e+06 | 1.19179e+06 | -66218.1 | ms | -5.26% |
| 100th percentile service time | force-merge | 1.25801e+06 | 1.19179e+06 | -66218.1 | ms | -5.26% |
| error rate | force-merge | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | knn-search-10-100 | 35.9679 | 156.939 | 120.971 | ops/s | +336.33% |
| Mean Throughput | knn-search-10-100 | 119.182 | 201.061 | 81.8798 | ops/s | +68.70% |
| Median Throughput | knn-search-10-100 | 118.987 | 201.061 | 82.074 | ops/s | +68.98% |
| Max Throughput | knn-search-10-100 | 202.59 | 245.184 | 42.5941 | ops/s | +21.02% |
| 50th percentile latency | knn-search-10-100 | 1.81169 | 1.41969 | -0.392 | ms | -21.64% |
| 90th percentile latency | knn-search-10-100 | 3.00174 | 1.70305 | -1.29868 | ms | -43.26% |
| 99th percentile latency | knn-search-10-100 | 5.2916 | 2.35815 | -2.93346 | ms | -55.44% |
| 99.9th percentile latency | knn-search-10-100 | 6.26335 | 3.66 | -2.60335 | ms | -41.56% |
| 100th percentile latency | knn-search-10-100 | 7.02746 | 215.784 | 208.757 | ms | +2970.58% |
| 50th percentile service time | knn-search-10-100 | 1.81169 | 1.41969 | -0.392 | ms | -21.64% |
| 90th percentile service time | knn-search-10-100 | 3.00174 | 1.70305 | -1.29868 | ms | -43.26% |
| 99th percentile service time | knn-search-10-100 | 5.2916 | 2.35815 | -2.93346 | ms | -55.44% |
| 99.9th percentile service time | knn-search-10-100 | 6.26335 | 3.66 | -2.60335 | ms | -41.56% |
| 100th percentile service time | knn-search-10-100 | 7.02746 | 215.784 | 208.757 | ms | +2970.58% |
| error rate | knn-search-10-100 | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | knn-search-100-1000 | 158.876 | 187.507 | 28.631 | ops/s | +18.02% |
| Mean Throughput | knn-search-100-1000 | 172.811 | 192.977 | 20.1666 | ops/s | +11.67% |
| Median Throughput | knn-search-100-1000 | 175.902 | 194.695 | 18.793 | ops/s | +10.68% |
| Max Throughput | knn-search-100-1000 | 177.38 | 194.997 | 17.6168 | ops/s | +9.93% |
| 50th percentile latency | knn-search-100-1000 | 5.31683 | 4.90969 | -0.40715 | ms | -7.66% |
| 90th percentile latency | knn-search-100-1000 | 6.93401 | 6.41097 | -0.52305 | ms | -7.54% |
| 99th percentile latency | knn-search-100-1000 | 8.07856 | 7.37515 | -0.7034 | ms | -8.71% |
| 99.9th percentile latency | knn-search-100-1000 | 8.68925 | 7.97126 | -0.71799 | ms | -8.26% |
| 100th percentile latency | knn-search-100-1000 | 15.0955 | 8.47708 | -6.61838 | ms | -43.84% |
| 50th percentile service time | knn-search-100-1000 | 5.31683 | 4.90969 | -0.40715 | ms | -7.66% |
| 90th percentile service time | knn-search-100-1000 | 6.93401 | 6.41097 | -0.52305 | ms | -7.54% |
| 99th percentile service time | knn-search-100-1000 | 8.07856 | 7.37515 | -0.7034 | ms | -8.71% |
| 99.9th percentile service time | knn-search-100-1000 | 8.68925 | 7.97126 | -0.71799 | ms | -8.26% |
| 100th percentile service time | knn-search-100-1000 | 15.0955 | 8.47708 | -6.61838 | ms | -43.84% |
| error rate | knn-search-100-1000 | 0 | 0 | 0 | % | 0.00% |
| Min Throughput | script-score-query | 5.39448 | 5.43831 | 0.04382 | ops/s | +0.81% |
| Mean Throughput | script-score-query | 5.45028 | 5.45721 | 0.00692 | ops/s | +0.13% |
| Median Throughput | script-score-query | 5.45306 | 5.45895 | 0.00589 | ops/s | +0.11% |
| Max Throughput | script-score-query | 5.46338 | 5.46778 | 0.0044 | ops/s | +0.08% |
| 50th percentile latency | script-score-query | 181.511 | 181.616 | 0.10519 | ms | +0.06% |
| 90th percentile latency | script-score-query | 184.022 | 183.73 | -0.29194 | ms | -0.16% |
| 99th percentile latency | script-score-query | 202.434 | 206.494 | 4.0599 | ms | +2.01% |
| 99.9th percentile latency | script-score-query | 223.05 | 245.748 | 22.698 | ms | +10.18% |
| 100th percentile latency | script-score-query | 232.609 | 250.067 | 17.4583 | ms | +7.51% |
| 50th percentile service time | script-score-query | 181.511 | 181.616 | 0.10519 | ms | +0.06% |
| 90th percentile service time | script-score-query | 184.022 | 183.73 | -0.29194 | ms | -0.16% |
| 99th percentile service time | script-score-query | 202.434 | 206.494 | 4.0599 | ms | +2.01% |
| 99.9th percentile service time | script-score-query | 223.05 | 245.748 | 22.698 | ms | +10.18% |
| 100th percentile service time | script-score-query | 232.609 | 250.067 | 17.4583 | ms | +7.51% |
| error rate | script-score-query | 0 | 0 | 0 | % | 0.00% |
-------------------------------
[INFO] SUCCESS (took 0 seconds)
-------------------------------
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment