Skip to content

Instantly share code, notes, and snippets.

@dpo

dpo/benchmark-commit.md

Created November 10, 2018 16:40
Show Gist options
  • Save dpo/a63ab424dd9a848d9c0d267102d282f6 to your computer and use it in GitHub Desktop.
Save dpo/a63ab424dd9a848d9c0d267102d282f6 to your computer and use it in GitHub Desktop.
Download ZIP
A benchmark for Krylov repository
Raw
benchmark-commit.md

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 10 Nov 2018 - 11:36
  • Package commit: 533f7f
  • Julia commit: a4cb80
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128"] 9.147 s (5%) 345.280 μs 48.17 MiB (1%) 2896
["CG", "DivGrad N=32"] 17.963 ms (5%) 811.03 KiB (1%) 727
["CG", "DivGrad N=64"] 366.191 ms (5%) 6.08 MiB (1%) 1443
["CG", "UFL-large", "Cannizzo/sts4098"] 290.694 ms (5%) 814.779 μs 2.72 MiB (1%) 45107
["CG", "UFL-large", "GHS_psdef/obstclae"] 309.100 μs (5%) 939.02 KiB (1%) 29
["CG", "UFL-large", "GHS_psdef/torsion1"] 306.508 μs (5%) 939.05 KiB (1%) 31
["CG", "UFL-medium", "Bates/Chem97ZtZ"] 895.903 μs (5%) 117.03 KiB (1%) 980
["CG", "UFL-medium", "Boeing/nasa1824"] 56.904 ms (5%) 1.19 MiB (1%) 20088
["CG", "UFL-medium", "HB/bcsstk09"] 2.733 ms (5%) 151.98 KiB (1%) 2155
["CG", "UFL-medium", "HB/plat1919"] 51.751 ms (5%) 1.25 MiB (1%) 21133
["CG", "UFL-medium", "Oberwolfach/t3dl_e"] 19.443 ms (5%) 650.09 KiB (1%) 2907
["CG", "UFL-small", "FIDAP/ex5"] 34.638 μs (5%) 19.06 KiB (1%) 315
["CG", "UFL-small", "HB/494_bus"] 1.364 ms (5%) 329.67 KiB (1%) 5456
["CG", "UFL-small", "HB/bcsstk01"] 65.028 μs (5%) 33.33 KiB (1%) 547
["CG", "UFL-small", "HB/plat362"] 1.901 ms (5%) 244.17 KiB (1%) 4004

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG"]
  • ["CG", "UFL-large"]
  • ["CG", "UFL-medium"]
  • ["CG", "UFL-small"]

Julia versioninfo

Julia Version 0.7.0
Commit a4cb80f3ed (2018-08-08 06:46 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin14.5.0)
  uname: Darwin 18.2.0 Darwin Kernel Version 18.2.0: Fri Oct  5 19:41:49 PDT 2018; root:xnu-4903.221.2~2/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz      62148 s          0 s      78296 s     606351 s          0 s
       #2  3100 MHz       8130 s          0 s       7708 s     730709 s          0 s
       #3  3100 MHz      56787 s          0 s      45423 s     644340 s          0 s
       #4  3100 MHz       7775 s          0 s       5884 s     732887 s          0 s
       #5  3100 MHz      49317 s          0 s      32559 s     664672 s          0 s
       #6  3100 MHz       7432 s          0 s       4814 s     734300 s          0 s
       #7  3100 MHz      41432 s          0 s      24153 s     680963 s          0 s
       #8  3100 MHz       7157 s          0 s       4120 s     735268 s          0 s
       
  Memory: 16.0 GB (1663.3984375 MB free)
  Uptime: 269124.0 sec
  Load Avg:  3.35595703125  2.73291015625  2.2109375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.0 (ORCJIT, skylake)
Raw
benchmark-master.md

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 10 Nov 2018 - 11:38
  • Package commit: 2700fc
  • Julia commit: a4cb80
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128"] 9.182 s (5%) 290.802 μs 48.01 MiB (1%) 18
["CG", "DivGrad N=32"] 18.705 ms (5%) 770.67 KiB (1%) 16
["CG", "DivGrad N=64"] 361.384 ms (5%) 6.00 MiB (1%) 17
["CG", "UFL-large", "Cannizzo/sts4098"] 295.707 ms (5%) 225.23 KiB (1%) 22
["CG", "UFL-large", "GHS_psdef/obstclae"] 317.505 μs (5%) 938.03 KiB (1%) 11
["CG", "UFL-large", "GHS_psdef/torsion1"] 301.406 μs (5%) 938.06 KiB (1%) 13
["CG", "UFL-medium", "Bates/Chem97ZtZ"] 817.593 μs (5%) 62.30 KiB (1%) 16
["CG", "UFL-medium", "Boeing/nasa1824"] 61.664 ms (5%) 75.81 KiB (1%) 17
["CG", "UFL-medium", "HB/bcsstk09"] 2.602 ms (5%) 30.38 KiB (1%) 14
["CG", "UFL-medium", "HB/plat1919"] 50.562 ms (5%) 78.06 KiB (1%) 17
["CG", "UFL-medium", "Oberwolfach/t3dl_e"] 19.643 ms (5%) 485.98 KiB (1%) 18
["CG", "UFL-small", "FIDAP/ex5"] 8.879 μs (5%) 1.83 KiB (1%) 11
["CG", "UFL-small", "HB/494_bus"] 1.786 ms (5%) 20.56 KiB (1%) 15
["CG", "UFL-small", "HB/bcsstk01"] 19.592 μs (5%) 2.97 KiB (1%) 12
["CG", "UFL-small", "HB/plat362"] 1.717 ms (5%) 17.56 KiB (1%) 15

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG"]
  • ["CG", "UFL-large"]
  • ["CG", "UFL-medium"]
  • ["CG", "UFL-small"]

Julia versioninfo

Julia Version 0.7.0
Commit a4cb80f3ed (2018-08-08 06:46 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin14.5.0)
  uname: Darwin 18.2.0 Darwin Kernel Version 18.2.0: Fri Oct  5 19:41:49 PDT 2018; root:xnu-4903.221.2~2/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz      62574 s          0 s      78382 s     606749 s          0 s
       #2  3100 MHz       8166 s          0 s       7724 s     731567 s          0 s
       #3  3100 MHz      57227 s          0 s      45491 s     644741 s          0 s
       #4  3100 MHz       7806 s          0 s       5898 s     733752 s          0 s
       #5  3100 MHz      49786 s          0 s      32622 s     665050 s          0 s
       #6  3100 MHz       7456 s          0 s       4824 s     735174 s          0 s
       #7  3100 MHz      41883 s          0 s      24214 s     681360 s          0 s
       #8  3100 MHz       7179 s          0 s       4129 s     736146 s          0 s
       
  Memory: 16.0 GB (1896.296875 MB free)
  Uptime: 269215.0 sec
  Load Avg:  3.212890625  2.78466796875  2.27783203125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.0 (ORCJIT, skylake)
Raw
judgement.md

Benchmark Report for Krylov

Job Properties

  • Time of benchmarks:
    • Target: 10 Nov 2018 - 11:36
    • Baseline: 10 Nov 2018 - 11:38
  • Package commits:
    • Target: 533f7f
    • Baseline: 2700fc
  • Julia commits:
    • Target: a4cb80
    • Baseline: a4cb80
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["CG", "DivGrad N=32"] 0.96 (5%) 1.05 (1%) ❌
["CG", "DivGrad N=64"] 1.01 (5%) 1.01 (1%) ❌
["CG", "UFL-large", "Cannizzo/sts4098"] 0.98 (5%) 12.37 (1%) ❌
["CG", "UFL-medium", "Bates/Chem97ZtZ"] 1.10 (5%) ❌ 1.88 (1%) ❌
["CG", "UFL-medium", "Boeing/nasa1824"] 0.92 (5%) ✅ 16.04 (1%) ❌
["CG", "UFL-medium", "HB/bcsstk09"] 1.05 (5%) ❌ 5.00 (1%) ❌
["CG", "UFL-medium", "HB/plat1919"] 1.02 (5%) 16.37 (1%) ❌
["CG", "UFL-medium", "Oberwolfach/t3dl_e"] 0.99 (5%) 1.34 (1%) ❌
["CG", "UFL-small", "FIDAP/ex5"] 3.90 (5%) ❌ 10.43 (1%) ❌
["CG", "UFL-small", "HB/494_bus"] 0.76 (5%) ✅ 16.03 (1%) ❌
["CG", "UFL-small", "HB/bcsstk01"] 3.32 (5%) ❌ 11.23 (1%) ❌
["CG", "UFL-small", "HB/plat362"] 1.11 (5%) ❌ 13.90 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG"]
  • ["CG", "UFL-large"]
  • ["CG", "UFL-medium"]
  • ["CG", "UFL-small"]

Julia versioninfo

Target

Julia Version 0.7.0
Commit a4cb80f3ed (2018-08-08 06:46 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin14.5.0)
  uname: Darwin 18.2.0 Darwin Kernel Version 18.2.0: Fri Oct  5 19:41:49 PDT 2018; root:xnu-4903.221.2~2/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz      62148 s          0 s      78296 s     606351 s          0 s
       #2  3100 MHz       8130 s          0 s       7708 s     730709 s          0 s
       #3  3100 MHz      56787 s          0 s      45423 s     644340 s          0 s
       #4  3100 MHz       7775 s          0 s       5884 s     732887 s          0 s
       #5  3100 MHz      49317 s          0 s      32559 s     664672 s          0 s
       #6  3100 MHz       7432 s          0 s       4814 s     734300 s          0 s
       #7  3100 MHz      41432 s          0 s      24153 s     680963 s          0 s
       #8  3100 MHz       7157 s          0 s       4120 s     735268 s          0 s
       
  Memory: 16.0 GB (1663.3984375 MB free)
  Uptime: 269124.0 sec
  Load Avg:  3.35595703125  2.73291015625  2.2109375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.0 (ORCJIT, skylake)

Baseline

Julia Version 0.7.0
Commit a4cb80f3ed (2018-08-08 06:46 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin14.5.0)
  uname: Darwin 18.2.0 Darwin Kernel Version 18.2.0: Fri Oct  5 19:41:49 PDT 2018; root:xnu-4903.221.2~2/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz      62574 s          0 s      78382 s     606749 s          0 s
       #2  3100 MHz       8166 s          0 s       7724 s     731567 s          0 s
       #3  3100 MHz      57227 s          0 s      45491 s     644741 s          0 s
       #4  3100 MHz       7806 s          0 s       5898 s     733752 s          0 s
       #5  3100 MHz      49786 s          0 s      32622 s     665050 s          0 s
       #6  3100 MHz       7456 s          0 s       4824 s     735174 s          0 s
       #7  3100 MHz      41883 s          0 s      24214 s     681360 s          0 s
       #8  3100 MHz       7179 s          0 s       4129 s     736146 s          0 s
       
  Memory: 16.0 GB (1896.296875 MB free)
  Uptime: 269215.0 sec
  Load Avg:  3.212890625  2.78466796875  2.27783203125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.0 (ORCJIT, skylake)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment