Created
September 10, 2025 15:30
-
-
Save jesusvazquez/90323f4bb976b4dd661b76c3b7c71dab to your computer and use it in GitHub Desktop.
parquet-common benchstat june-september 2025 diff
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ❯ benchstat main-1249aa9 main-2854801 | |
| goos: darwin | |
| goarch: arm64 | |
| pkg: github.com/prometheus-community/parquet-common/queryable | |
| cpu: Apple M2 Pro | |
| │ main-1249aa9 │ main-2854801 │ | |
| │ sec/op │ sec/op vs base │ | |
| Select/SingleMetricAllSeries-12 436.9m ± 2% 254.0m ± 6% -41.85% (p=0.002 n=6) | |
| Select/SingleMetricReducedSeries-12 84.972m ± 2% 7.593m ± 15% -91.06% (p=0.002 n=6) | |
| Select/SingleMetricOneSeries-12 83.497m ± 2% 6.001m ± 10% -92.81% (p=0.002 n=6) | |
| Select/SingleMetricSparseSeries-12 140.81m ± 2% 18.60m ± 28% -86.79% (p=0.002 n=6) | |
| Select/NonExistentSeries-12 82.534m ± 3% 5.360m ± 4% -93.51% (p=0.002 n=6) | |
| Select/MultipleMetricsRange-12 1.846 ± 8% 1.033 ± 4% -44.05% (p=0.002 n=6) | |
| Select/MultipleMetricsSparse-12 697.7m ± 7% 250.1m ± 2% -64.15% (p=0.002 n=6) | |
| Select/NegativeRegexSingleMetric-12 417.1m ± 3% 202.8m ± 7% -51.37% (p=0.002 n=6) | |
| Select/NegativeRegexMultipleMetrics-12 1382.4m ± 8% 631.6m ± 14% -54.31% (p=0.002 n=6) | |
| Select/ExpensiveRegexSingleMetric-12 166.27m ± 3% 12.11m ± 4% -92.72% (p=0.002 n=6) | |
| Select/ExpensiveRegexMultipleMetrics-12 503.58m ± 3% 11.03m ± 9% -97.81% (p=0.002 n=6) | |
| geomean 306.5m 50.20m -83.62% | |
| │ main-1249aa9 │ main-2854801 │ | |
| │ bytes_get_range/op │ bytes_get_range/op vs base │ | |
| Select/SingleMetricAllSeries-12 9.137M ± 0% 5.678M ± 0% -37.85% (p=0.002 n=6) | |
| Select/SingleMetricReducedSeries-12 2029.3k ± 0% 327.4k ± 0% -83.87% (p=0.002 n=6) | |
| Select/SingleMetricOneSeries-12 1978.0k ± 0% 280.5k ± 0% -85.82% (p=0.002 n=6) | |
| Select/SingleMetricSparseSeries-12 5.487M ± 0% 1.976M ± 0% -64.00% (p=0.002 n=6) | |
| Select/NonExistentSeries-12 1938.7k ± 0% 270.6k ± 0% -86.04% (p=0.002 n=6) | |
| Select/MultipleMetricsRange-12 38.01M ± 0% 22.71M ± 0% -40.24% (p=0.002 n=6) | |
| Select/MultipleMetricsSparse-12 16.411M ± 0% 6.490M ± 0% -60.45% (p=0.002 n=6) | |
| Select/NegativeRegexSingleMetric-12 9.394M ± 0% 4.758M ± 0% -49.36% (p=0.002 n=6) | |
| Select/NegativeRegexMultipleMetrics-12 31.58M ± 0% 14.27M ± 0% -54.80% (p=0.002 n=6) | |
| Select/ExpensiveRegexSingleMetric-12 3923.5k ± 0% 472.8k ± 0% -87.95% (p=0.002 n=6) | |
| Select/ExpensiveRegexMultipleMetrics-12 14736.1k ± 0% 811.8k ± 0% -94.49% (p=0.002 n=6) | |
| geomean 7.492M 1.886M -74.83% | |
| │ main-1249aa9 │ main-2854801 │ | |
| │ get/op │ get/op vs base │ | |
| Select/SingleMetricAllSeries-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/SingleMetricReducedSeries-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/SingleMetricOneSeries-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/SingleMetricSparseSeries-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/NonExistentSeries-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/MultipleMetricsRange-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/MultipleMetricsSparse-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/NegativeRegexSingleMetric-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/NegativeRegexMultipleMetrics-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/ExpensiveRegexSingleMetric-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/ExpensiveRegexMultipleMetrics-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| geomean ² +0.00% ² | |
| ¹ all samples are equal | |
| ² summaries must be >0 to compute geomean | |
| │ main-1249aa9 │ main-2854801 │ | |
| │ get_range/op │ get_range/op vs base │ | |
| Select/SingleMetricAllSeries-12 19.163k ± 0% 5.400k ± 0% -71.82% (p=0.002 n=6) | |
| Select/SingleMetricReducedSeries-12 10925.0 ± 0% 654.0 ± 0% -94.01% (p=0.002 n=6) | |
| Select/SingleMetricOneSeries-12 10905.0 ± 0% 624.0 ± 0% -94.28% (p=0.002 n=6) | |
| Select/SingleMetricSparseSeries-12 18.001k ± 0% 3.000k ± 0% -83.33% (p=0.002 n=6) | |
| Select/NonExistentSeries-12 10763.0 ± 0% 600.0 ± 0% -94.43% (p=0.002 n=6) | |
| Select/MultipleMetricsRange-12 72.41k ± 0% 21.60k ± 0% -70.17% (p=0.002 n=6) | |
| Select/MultipleMetricsSparse-12 47.213k ± 0% 7.200k ± 0% -84.75% (p=0.002 n=6) | |
| Select/NegativeRegexSingleMetric-12 25.078k ± 0% 4.944k ± 0% -80.29% (p=0.002 n=6) | |
| Select/NegativeRegexMultipleMetrics-12 81.76k ± 0% 14.83k ± 0% -81.86% (p=0.002 n=6) | |
| Select/ExpensiveRegexSingleMetric-12 18694.0 ± 0% 906.0 ± 0% -95.15% (p=0.002 n=6) | |
| Select/ExpensiveRegexMultipleMetrics-12 62.100k ± 0% 1.800k ± 0% -97.10% (p=0.002 n=6) | |
| geomean 25.95k 2.770k -89.33% | |
| │ main-1249aa9 │ main-2854801 │ | |
| │ series/op │ series/op vs base │ | |
| Select/SingleMetricAllSeries-12 300.0k ± 0% 300.0k ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/SingleMetricReducedSeries-12 3.000k ± 0% 3.000k ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/SingleMetricOneSeries-12 1.000 ± 0% 1.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/SingleMetricSparseSeries-12 5.000k ± 0% 5.000k ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/NonExistentSeries-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/MultipleMetricsRange-12 1.200M ± 0% 1.200M ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/MultipleMetricsSparse-12 300.0k ± 0% 300.0k ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/NegativeRegexSingleMetric-12 234.0k ± 0% 234.0k ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/NegativeRegexMultipleMetrics-12 702.0k ± 0% 702.0k ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/ExpensiveRegexSingleMetric-12 6.000k ± 0% 6.000k ± 0% ~ (p=1.000 n=6) ¹ | |
| Select/ExpensiveRegexMultipleMetrics-12 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=6) ¹ | |
| geomean ² +0.00% ² | |
| ¹ all samples are equal | |
| ² summaries must be >0 to compute geomean | |
| │ main-1249aa9 │ main-2854801 │ | |
| │ B/op │ B/op vs base │ | |
| Select/SingleMetricAllSeries-12 787.3Mi ± 0% 724.3Mi ± 0% -7.99% (p=0.002 n=6) | |
| Select/SingleMetricReducedSeries-12 77.49Mi ± 0% 13.44Mi ± 0% -82.65% (p=0.002 n=6) | |
| Select/SingleMetricOneSeries-12 72.787Mi ± 0% 8.224Mi ± 0% -88.70% (p=0.002 n=6) | |
| Select/SingleMetricSparseSeries-12 140.76Mi ± 0% 41.28Mi ± 0% -70.67% (p=0.002 n=6) | |
| Select/NonExistentSeries-12 69.803Mi ± 0% 6.200Mi ± 0% -91.12% (p=0.002 n=6) | |
| Select/MultipleMetricsRange-12 3.146Gi ± 0% 2.829Gi ± 0% -10.10% (p=0.002 n=6) | |
| Select/MultipleMetricsSparse-12 1083.1Mi ± 0% 738.9Mi ± 0% -31.77% (p=0.002 n=6) | |
| Select/NegativeRegexSingleMetric-12 729.6Mi ± 0% 605.0Mi ± 0% -17.07% (p=0.002 n=6) | |
| Select/NegativeRegexMultipleMetrics-12 2.213Gi ± 0% 1.705Gi ± 0% -22.96% (p=0.002 n=6) | |
| Select/ExpensiveRegexSingleMetric-12 202.65Mi ± 0% 23.94Mi ± 0% -88.19% (p=0.002 n=6) | |
| Select/ExpensiveRegexMultipleMetrics-12 573.05Mi ± 0% 18.68Mi ± 0% -96.74% (p=0.002 n=6) | |
| geomean 387.1Mi 106.8Mi -72.40% | |
| │ main-1249aa9 │ main-2854801 │ | |
| │ allocs/op │ allocs/op vs base │ | |
| Select/SingleMetricAllSeries-12 9.960M ± 0% 8.642M ± 0% -13.23% (p=0.002 n=6) | |
| Select/SingleMetricReducedSeries-12 355.1k ± 0% 208.4k ± 0% -41.32% (p=0.002 n=6) | |
| Select/SingleMetricOneSeries-12 331.7k ± 0% 196.2k ± 0% -40.84% (p=0.002 n=6) | |
| Select/SingleMetricSparseSeries-12 755.9k ± 0% 549.5k ± 0% -27.31% (p=0.002 n=6) | |
| Select/NonExistentSeries-12 256.1k ± 0% 122.3k ± 0% -52.27% (p=0.002 n=6) | |
| Select/MultipleMetricsRange-12 40.14M ± 0% 34.50M ± 0% -14.05% (p=0.002 n=6) | |
| Select/MultipleMetricsSparse-12 11.103M ± 0% 8.864M ± 0% -20.17% (p=0.002 n=6) | |
| Select/NegativeRegexSingleMetric-12 8.504M ± 0% 7.350M ± 0% -13.56% (p=0.002 n=6) | |
| Select/NegativeRegexMultipleMetrics-12 24.99M ± 0% 20.98M ± 0% -16.07% (p=0.002 n=6) | |
| Select/ExpensiveRegexSingleMetric-12 1027.8k ± 0% 348.1k ± 0% -66.13% (p=0.002 n=6) | |
| Select/ExpensiveRegexMultipleMetrics-12 2168.2k ± 0% 326.5k ± 0% -84.94% (p=0.002 n=6) | |
| geomean 2.664M 1.554M -41.68% |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment