Skip to content

Instantly share code, notes, and snippets.

@dpo
Created November 11, 2018 03:53
Show Gist options
  • Save dpo/d0d03774882b157ff8039b1c7a450149 to your computer and use it in GitHub Desktop.
Save dpo/d0d03774882b157ff8039b1c7a450149 to your computer and use it in GitHub Desktop.
A benchmark for Krylov repository

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 10 Nov 2018 - 22:51
  • Package commit: a9745c
  • Julia commit: a4cb80
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128"] 9.339 s (5%) 312.340 μs 48.02 MiB (1%) 187
["CG", "DivGrad N=32"] 18.785 ms (5%) 770.75 KiB (1%) 18
["CG", "DivGrad N=64"] 380.177 ms (5%) 6.00 MiB (1%) 19
["CG", "UFL-large", "Cannizzo/sts4098"] 303.775 ms (5%) 225.31 KiB (1%) 24
["CG", "UFL-large", "GHS_psdef/obstclae"] 320.055 μs (5%) 938.11 KiB (1%) 13
["CG", "UFL-large", "GHS_psdef/torsion1"] 312.919 μs (5%) 938.14 KiB (1%) 15
["CG", "UFL-medium", "Bates/Chem97ZtZ"] 839.136 μs (5%) 62.38 KiB (1%) 18
["CG", "UFL-medium", "Boeing/nasa1824"] 65.575 ms (5%) 75.89 KiB (1%) 19
["CG", "UFL-medium", "HB/bcsstk09"] 2.561 ms (5%) 30.45 KiB (1%) 16
["CG", "UFL-medium", "HB/plat1919"] 52.682 ms (5%) 78.14 KiB (1%) 19
["CG", "UFL-medium", "Oberwolfach/t3dl_e"] 20.259 ms (5%) 486.06 KiB (1%) 20
["CG", "UFL-small", "FIDAP/ex5"] 12.802 μs (5%) 1.91 KiB (1%) 13
["CG", "UFL-small", "HB/494_bus"] 1.877 ms (5%) 20.64 KiB (1%) 17
["CG", "UFL-small", "HB/bcsstk01"] 27.020 μs (5%) 3.05 KiB (1%) 14
["CG", "UFL-small", "HB/plat362"] 1.871 ms (5%) 17.64 KiB (1%) 17

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG"]
  • ["CG", "UFL-large"]
  • ["CG", "UFL-medium"]
  • ["CG", "UFL-small"]

Julia versioninfo

Julia Version 0.7.0
Commit a4cb80f3ed (2018-08-08 06:46 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin14.5.0)
  uname: Darwin 18.2.0 Darwin Kernel Version 18.2.0: Fri Oct  5 19:41:49 PDT 2018; root:xnu-4903.221.2~2/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz      79504 s          0 s      96181 s     719500 s          0 s
       #2  3100 MHz       9931 s          0 s       9643 s     875339 s          0 s
       #3  3100 MHz      72661 s          0 s      55950 s     766306 s          0 s
       #4  3100 MHz       9500 s          0 s       7433 s     877980 s          0 s
       #5  3100 MHz      62864 s          0 s      40485 s     791567 s          0 s
       #6  3100 MHz       9094 s          0 s       6140 s     879677 s          0 s
       #7  3100 MHz      52565 s          0 s      30176 s     812174 s          0 s
       #8  3100 MHz       8734 s          0 s       5257 s     880920 s          0 s
       
  Memory: 16.0 GB (1042.84375 MB free)
  Uptime: 309596.0 sec
  Load Avg:  4.490234375  3.158203125  2.54052734375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.0 (ORCJIT, skylake)

Benchmark Report for Krylov

Job Properties

  • Time of benchmark: 10 Nov 2018 - 22:52
  • Package commit: 2700fc
  • Julia commit: a4cb80
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["CG", "DivGrad N=128"] 9.342 s (5%) 298.369 μs 48.01 MiB (1%) 18
["CG", "DivGrad N=32"] 18.271 ms (5%) 770.67 KiB (1%) 16
["CG", "DivGrad N=64"] 374.188 ms (5%) 794.195 μs 6.00 MiB (1%) 17
["CG", "UFL-large", "Cannizzo/sts4098"] 301.969 ms (5%) 225.23 KiB (1%) 22
["CG", "UFL-large", "GHS_psdef/obstclae"] 306.590 μs (5%) 938.03 KiB (1%) 11
["CG", "UFL-large", "GHS_psdef/torsion1"] 308.901 μs (5%) 938.06 KiB (1%) 13
["CG", "UFL-medium", "Bates/Chem97ZtZ"] 827.138 μs (5%) 62.30 KiB (1%) 16
["CG", "UFL-medium", "Boeing/nasa1824"] 63.480 ms (5%) 75.81 KiB (1%) 17
["CG", "UFL-medium", "HB/bcsstk09"] 2.571 ms (5%) 30.38 KiB (1%) 14
["CG", "UFL-medium", "HB/plat1919"] 52.134 ms (5%) 78.06 KiB (1%) 17
["CG", "UFL-medium", "Oberwolfach/t3dl_e"] 19.253 ms (5%) 485.98 KiB (1%) 18
["CG", "UFL-small", "FIDAP/ex5"] 8.850 μs (5%) 1.83 KiB (1%) 11
["CG", "UFL-small", "HB/494_bus"] 1.735 ms (5%) 20.56 KiB (1%) 15
["CG", "UFL-small", "HB/bcsstk01"] 19.475 μs (5%) 2.97 KiB (1%) 12
["CG", "UFL-small", "HB/plat362"] 1.696 ms (5%) 17.56 KiB (1%) 15

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG"]
  • ["CG", "UFL-large"]
  • ["CG", "UFL-medium"]
  • ["CG", "UFL-small"]

Julia versioninfo

Julia Version 0.7.0
Commit a4cb80f3ed (2018-08-08 06:46 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin14.5.0)
  uname: Darwin 18.2.0 Darwin Kernel Version 18.2.0: Fri Oct  5 19:41:49 PDT 2018; root:xnu-4903.221.2~2/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz      79936 s          0 s      96270 s     719895 s          0 s
       #2  3100 MHz       9976 s          0 s       9663 s     876192 s          0 s
       #3  3100 MHz      73115 s          0 s      56024 s     766695 s          0 s
       #4  3100 MHz       9539 s          0 s       7450 s     878840 s          0 s
       #5  3100 MHz      63321 s          0 s      40554 s     791958 s          0 s
       #6  3100 MHz       9129 s          0 s       6155 s     880545 s          0 s
       #7  3100 MHz      53022 s          0 s      30242 s     812568 s          0 s
       #8  3100 MHz       8765 s          0 s       5270 s     881793 s          0 s
       
  Memory: 16.0 GB (1717.453125 MB free)
  Uptime: 309688.0 sec
  Load Avg:  3.48291015625  3.134765625  2.59228515625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.0 (ORCJIT, skylake)

Benchmark Report for Krylov

Job Properties

  • Time of benchmarks:
    • Target: 10 Nov 2018 - 22:51
    • Baseline: 10 Nov 2018 - 22:52
  • Package commits:
    • Target: a9745c
    • Baseline: 2700fc
  • Julia commits:
    • Target: a4cb80
    • Baseline: a4cb80
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["CG", "UFL-medium", "Oberwolfach/t3dl_e"] 1.05 (5%) ❌ 1.00 (1%)
["CG", "UFL-small", "FIDAP/ex5"] 1.45 (5%) ❌ 1.04 (1%) ❌
["CG", "UFL-small", "HB/494_bus"] 1.08 (5%) ❌ 1.00 (1%)
["CG", "UFL-small", "HB/bcsstk01"] 1.39 (5%) ❌ 1.03 (1%) ❌
["CG", "UFL-small", "HB/plat362"] 1.10 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["CG"]
  • ["CG", "UFL-large"]
  • ["CG", "UFL-medium"]
  • ["CG", "UFL-small"]

Julia versioninfo

Target

Julia Version 0.7.0
Commit a4cb80f3ed (2018-08-08 06:46 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin14.5.0)
  uname: Darwin 18.2.0 Darwin Kernel Version 18.2.0: Fri Oct  5 19:41:49 PDT 2018; root:xnu-4903.221.2~2/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz      79504 s          0 s      96181 s     719500 s          0 s
       #2  3100 MHz       9931 s          0 s       9643 s     875339 s          0 s
       #3  3100 MHz      72661 s          0 s      55950 s     766306 s          0 s
       #4  3100 MHz       9500 s          0 s       7433 s     877980 s          0 s
       #5  3100 MHz      62864 s          0 s      40485 s     791567 s          0 s
       #6  3100 MHz       9094 s          0 s       6140 s     879677 s          0 s
       #7  3100 MHz      52565 s          0 s      30176 s     812174 s          0 s
       #8  3100 MHz       8734 s          0 s       5257 s     880920 s          0 s
       
  Memory: 16.0 GB (1042.84375 MB free)
  Uptime: 309596.0 sec
  Load Avg:  4.490234375  3.158203125  2.54052734375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.0 (ORCJIT, skylake)

Baseline

Julia Version 0.7.0
Commit a4cb80f3ed (2018-08-08 06:46 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin14.5.0)
  uname: Darwin 18.2.0 Darwin Kernel Version 18.2.0: Fri Oct  5 19:41:49 PDT 2018; root:xnu-4903.221.2~2/RELEASE_X86_64 x86_64 i386
  CPU: Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz: 
              speed         user         nice          sys         idle          irq
       #1  3100 MHz      79936 s          0 s      96270 s     719895 s          0 s
       #2  3100 MHz       9976 s          0 s       9663 s     876192 s          0 s
       #3  3100 MHz      73115 s          0 s      56024 s     766695 s          0 s
       #4  3100 MHz       9539 s          0 s       7450 s     878840 s          0 s
       #5  3100 MHz      63321 s          0 s      40554 s     791958 s          0 s
       #6  3100 MHz       9129 s          0 s       6155 s     880545 s          0 s
       #7  3100 MHz      53022 s          0 s      30242 s     812568 s          0 s
       #8  3100 MHz       8765 s          0 s       5270 s     881793 s          0 s
       
  Memory: 16.0 GB (1717.453125 MB free)
  Uptime: 309688.0 sec
  Load Avg:  3.48291015625  3.134765625  2.59228515625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.0 (ORCJIT, skylake)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment