Skip to content

Instantly share code, notes, and snippets.

@dpo

dpo/judgement.md

Last active March 16, 2026 15:15
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save dpo/59f8a509b7a105839b8ff6e1dab03ad8 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save dpo/59f8a509b7a105839b8ff6e1dab03ad8 to your computer and use it in GitHub Desktop.
Download ZIP
RegularizedOptimization repository benchmark
Raw
judgement.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmarks:
    • Target: 16 Mar 2026 - 15:13
    • Baseline: 16 Mar 2026 - 15:14
  • Package commits:
    • Target: ae7d95c
    • Baseline: c5606a2
  • Julia commits:
    • Target: 5fe89b8
    • Baseline: 5fe89b8
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Brackets display tolerances for the benchmark estimates. Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["R2", "bpdn_B0"] 3.74 (5%) ❌ 2.89 (1%) ❌
["R2", "bpdn_l0"] 0.90 (5%) ✅ 0.99 (1%)
["R2", "bpdn_l1"] 3.15 (5%) ❌ 1.10 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Target

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        423 s          0 s        252 s       1643 s          0 s  
       #2  2400 MHz        403 s          0 s        224 s       1691 s          0 s  
       #3  2400 MHz        383 s          0 s        196 s       1740 s          0 s  
  Memory: 7.0 GB (115.625 MB free)
  Uptime: 2321.0 sec
  Load Avg:  1.927734375  1.5537109375  2.25830078125
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)

Baseline

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        434 s          0 s        254 s       1663 s          0 s  
       #2  2400 MHz        414 s          0 s        225 s       1711 s          0 s  
       #3  2400 MHz        395 s          0 s        197 s       1759 s          0 s  
  Memory: 7.0 GB (64.1875 MB free)
  Uptime: 2353.0 sec
  Load Avg:  1.7041015625  1.5380859375  2.2236328125
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Display the source blob
Display the rendered blob
Raw
profiles_this_commit_vs_reference_R2.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Raw
reference.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmark: 16 Mar 2026 - 15:14
  • Package commit: c5606a2
  • Julia commit: 5fe89b8
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["R2", "bpdn_B0"] 2.640 ms (5%) 642.27 KiB (1%) 946
["R2", "bpdn_l0"] 426.944 ms (5%) 3.29 MiB (1%) 176301
["R2", "bpdn_l1"] 1.853 ms (5%) 336.62 KiB (1%) 666

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        434 s          0 s        254 s       1663 s          0 s  
       #2  2400 MHz        414 s          0 s        225 s       1711 s          0 s  
       #3  2400 MHz        395 s          0 s        197 s       1759 s          0 s  
  Memory: 7.0 GB (64.1875 MB free)
  Uptime: 2353.0 sec
  Load Avg:  1.7041015625  1.5380859375  2.2236328125
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Raw
tables.md

Solver Benchmarks Tables

This commit vs reference: R2_precise

This commit

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 2.23e-04 3 3 2
BPDN/ProximalOperators.NormL1 4.98e-01 4.41e-03 107 64 106
BPDN/ProximalOperators.IndBallL0 8.25e-03 7.88e-03 140 76 139

Reference

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 2.78e-03 3 3 2
BPDN/ProximalOperators.NormL1 4.98e-01 1.45e-03 27 26 26
BPDN/ProximalOperators.IndBallL0 8.25e-03 2.16e-03 29 29 28

This commit vs reference: R2_imprecise

This commit

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 0.00e+00 1 1 0
BPDN/ProximalOperators.NormL1 4.98e-01 1.88e-03 41 31 40
BPDN/ProximalOperators.IndBallL0 8.25e-03 3.77e-03 64 38 63

Reference

Name f(x) Time Obj Evals Grad Evals Iterations
BPDN/ProximalOperators.NormL0 1.79e+00 0.00e+00 1 1 0
BPDN/ProximalOperators.NormL1 4.98e-01 9.80e-04 19 18 18
BPDN/ProximalOperators.IndBallL0 8.25e-03 1.37e-03 19 19 18
Raw
this_commit.md

Benchmark Report for RegularizedOptimization

Job Properties

  • Time of benchmark: 16 Mar 2026 - 15:13
  • Package commit: ae7d95c
  • Julia commit: 5fe89b8
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["R2", "bpdn_B0"] 9.879 ms (5%) 1.81 MiB (1%) 4319
["R2", "bpdn_l0"] 383.284 ms (5%) 3.27 MiB (1%) 175079
["R2", "bpdn_l1"] 5.828 ms (5%) 369.67 KiB (1%) 2604

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["R2"]

Julia versioninfo

Julia Version 1.12.5
Commit 5fe89b8ddc1 (2026-02-09 16:05 UTC)
Build Info:
  Official https://julialang.org release
Platform Info:
  OS: macOS (arm64-apple-darwin24.0.0)
  uname: Darwin 24.6.0 Darwin Kernel Version 24.6.0: Mon Jan 19 22:02:01 PST 2026; root:xnu-11417.140.69.708.3~1/RELEASE_ARM64_VMAPPLE arm64 arm
  CPU: Apple M1 (Virtual): 
              speed         user         nice          sys         idle          irq
       #1  2400 MHz        423 s          0 s        252 s       1643 s          0 s  
       #2  2400 MHz        403 s          0 s        224 s       1691 s          0 s  
       #3  2400 MHz        383 s          0 s        196 s       1740 s          0 s  
  Memory: 7.0 GB (115.625 MB free)
  Uptime: 2321.0 sec
  Load Avg:  1.927734375  1.5537109375  2.25830078125
  WORD_SIZE: 64
  LLVM: libLLVM-18.1.7 (ORCJIT, apple-m1)
  GC: Built with stock GC
Threads: 1 default, 1 interactive, 1 GC (on 3 virtual cores)
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_allocations.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_gctime.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_imprecise.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_memory.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_precise.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
this_commit_vs_reference_R2_time.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment