Skip to content

Instantly share code, notes, and snippets.

@heckj

heckj/benchmark-comparison.md

Created October 10, 2024 20:17
Show Gist options
  • Save heckj/59395e4bc7fa4bf4db8407017e98fb0e to your computer and use it in GitHub Desktop.
Save heckj/59395e4bc7fa4bf4db8407017e98fb0e to your computer and use it in GitHub Desktop.
Download ZIP
FirebladeECS value types benchmarking
Raw
benchmark-comparison.md

Benchmarking switching FirebladeECS to use value types

Comparing results between branch master and the first commit from fireblade-engine/ecs#47 (2b51eeea6e379d4c66e04dc9103b199886993694)

Host 'MacBookPro' with 8 'arm64' processors with 16 GB memory, running:
Darwin Kernel Version 24.0.0: Tue Sep 24 23:36:26 PDT 2024; root:xnu-11215.1.12~1/RELEASE_ARM64_T8103

ECSBenchmark

TraitMatching metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 20 20 20 20 20 20 20 50
Current_run 23 23 23 23 23 24 24 44
Δ 3 3 3 3 3 4 4 -6
Improvement % -15 -15 -15 -15 -15 -20 -20 -6

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 20 20 20 20 20 20 20 50
Current_run 23 23 23 23 23 24 24 44
Δ 3 3 3 3 3 4 4 -6
Improvement % -15 -15 -15 -15 -15 -20 -20 -6

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 50 50 50 50 49 49 49 50
Current_run 44 44 44 43 43 42 42 44
Δ -6 -6 -6 -7 -6 -7 -7 -6
Improvement % -12 -12 -12 -14 -12 -14 -14 -6

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 14 16 16 16 16 16 16 50
Current_run 15 18 18 18 18 18 18 44
Δ 1 2 2 2 2 2 2 -6
Improvement % -7 -12 -12 -12 -12 -12 -12 -6

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 50
Current_run 230 230 230 230 230 230 230 44
Δ 0 0 0 0 0 0 0 -6
Improvement % 0 0 0 0 0 0 0 -6

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 280 280 280 280 280 281 281 50
Current_run 318 318 318 318 318 319 319 44
Δ 38 38 38 38 38 38 38 -6
Improvement % -14 -14 -14 -14 -14 -14 -14 -6

TypedFamilyEntities metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 20 20 20 20 20 21 21 50
Current_run 23 23 23 23 23 24 24 43
Δ 3 3 3 3 3 3 3 -7
Improvement % -15 -15 -15 -15 -15 -14 -14 -7

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 20 20 20 20 20 21 21 50
Current_run 23 23 23 23 23 24 24 43
Δ 3 3 3 3 3 3 3 -7
Improvement % -15 -15 -15 -15 -15 -14 -14 -7

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 50 50 50 49 49 49 49 50
Current_run 43 43 43 43 43 42 42 43
Δ -7 -7 -7 -6 -6 -7 -7 -7
Improvement % -14 -14 -14 -12 -12 -14 -14 -7

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 13 16 16 16 16 16 16 50
Current_run 15 18 18 18 18 18 18 43
Δ 2 2 2 2 2 2 2 -7
Improvement % -15 -12 -12 -12 -12 -12 -12 -7

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 50
Current_run 230 230 230 230 230 230 230 43
Δ 0 0 0 0 0 0 0 -7
Improvement % 0 0 0 0 0 0 0 -7

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 281 281 281 282 282 282 282 50
Current_run 318 319 319 319 319 319 319 43
Δ 37 38 38 37 37 37 37 -7
Improvement % -13 -14 -14 -13 -13 -13 -13 -7

TypedFamilyEntityFiveComponents metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 23 23 23 23 24 28 28 43
Current_run 29 29 29 29 29 30 30 35
Δ 6 6 6 6 5 2 2 -8
Improvement % -26 -26 -26 -26 -21 -7 -7 -8

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 23 23 23 23 24 27 27 43
Current_run 29 29 29 29 29 30 30 35
Δ 6 6 6 6 5 3 3 -8
Improvement % -26 -26 -26 -26 -21 -11 -11 -8

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 44 44 44 43 41 36 36 43
Current_run 35 35 35 34 34 34 34 35
Δ -9 -9 -9 -9 -7 -2 -2 -8
Improvement % -20 -20 -20 -21 -17 -6 -6 -8

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 14 16 16 16 16 16 16 43
Current_run 17 18 18 18 18 18 18 35
Δ 3 2 2 2 2 2 2 -8
Improvement % -21 -12 -12 -12 -12 -12 -12 -8

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 43
Current_run 230 230 230 230 230 230 230 35
Δ 0 0 0 0 0 0 0 -8
Improvement % 0 0 0 0 0 0 0 -8

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 314 314 314 315 315 315 315 43
Current_run 391 391 392 392 392 392 392 35
Δ 77 77 78 77 77 77 77 -8
Improvement % -25 -25 -25 -24 -24 -24 -24 -8

TypedFamilyEntityFourComponents metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 22 22 22 23 23 24 24 45
Current_run 28 28 28 29 29 29 29 36
Δ 6 6 6 6 6 5 5 -9
Improvement % -27 -27 -27 -26 -26 -21 -21 -9

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 22 22 22 23 23 24 24 45
Current_run 28 28 28 29 29 29 29 36
Δ 6 6 6 6 6 5 5 -9
Improvement % -27 -27 -27 -26 -26 -21 -21 -9

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 45 45 45 44 44 42 42 45
Current_run 36 36 35 35 35 34 34 36
Δ -9 -9 -10 -9 -9 -8 -8 -9
Improvement % -20 -20 -22 -20 -20 -19 -19 -9

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 13 16 16 16 16 16 16 45
Current_run 17 18 18 18 18 18 18 36
Δ 4 2 2 2 2 2 2 -9
Improvement % -31 -12 -12 -12 -12 -12 -12 -9

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 45
Current_run 230 230 230 230 230 230 230 36
Δ 0 0 0 0 0 0 0 -9
Improvement % 0 0 0 0 0 0 0 -9

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 308 309 309 309 309 310 310 45
Current_run 375 375 375 375 376 376 376 36
Δ 67 66 66 66 67 66 66 -9
Improvement % -22 -21 -21 -21 -22 -21 -21 -9

TypedFamilyEntityOneComponent metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 21 21 21 21 21 22 22 47
Current_run 24 24 24 24 24 25 25 42
Δ 3 3 3 3 3 3 3 -5
Improvement % -14 -14 -14 -14 -14 -14 -14 -5

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 21 21 21 21 21 22 22 47
Current_run 24 24 24 24 24 25 25 42
Δ 3 3 3 3 3 3 3 -5
Improvement % -14 -14 -14 -14 -14 -14 -14 -5

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 48 47 47 47 47 46 46 47
Current_run 42 42 42 42 41 41 41 42
Δ -6 -5 -5 -5 -6 -5 -5 -5
Improvement % -12 -11 -11 -11 -13 -11 -11 -5

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 13 16 16 16 16 16 16 47
Current_run 17 18 18 18 18 18 18 42
Δ 4 2 2 2 2 2 2 -5
Improvement % -31 -12 -12 -12 -12 -12 -12 -5

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 47
Current_run 230 230 230 230 230 230 230 42
Δ 0 0 0 0 0 0 0 -5
Improvement % 0 0 0 0 0 0 0 -5

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 291 291 291 292 292 292 292 47
Current_run 333 333 333 333 333 334 334 42
Δ 42 42 42 41 41 42 42 -5
Improvement % -14 -14 -14 -14 -14 -14 -14 -5

TypedFamilyEntityThreeComponents metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 22 22 22 22 22 23 23 46
Current_run 27 27 27 27 28 32 32 37
Δ 5 5 5 5 6 9 9 -9
Improvement % -23 -23 -23 -23 -27 -39 -39 -9

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 22 22 22 22 22 23 23 46
Current_run 27 27 27 27 28 30 30 37
Δ 5 5 5 5 6 7 7 -9
Improvement % -23 -23 -23 -23 -27 -30 -30 -9

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 46 46 46 46 45 44 44 46
Current_run 37 37 37 37 36 31 31 37
Δ -9 -9 -9 -9 -9 -13 -13 -9
Improvement % -20 -20 -20 -20 -20 -30 -30 -9

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 14 16 16 16 16 16 16 46
Current_run 17 18 18 18 18 18 18 37
Δ 3 2 2 2 2 2 2 -9
Improvement % -21 -12 -12 -12 -12 -12 -12 -9

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 46
Current_run 230 230 230 230 230 230 230 37
Δ 0 0 0 0 0 0 0 -9
Improvement % 0 0 0 0 0 0 0 -9

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 301 301 301 301 301 303 303 46
Current_run 365 365 365 365 365 366 366 37
Δ 64 64 64 64 64 63 63 -9
Improvement % -21 -21 -21 -21 -21 -21 -21 -9

TypedFamilyEntityTwoComponents metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 22 22 22 22 22 22 22 46
Current_run 25 25 26 26 26 29 29 39
Δ 3 3 4 4 4 7 7 -7
Improvement % -14 -14 -18 -18 -18 -32 -32 -7

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 22 22 22 22 22 22 22 46
Current_run 25 25 26 26 26 28 28 39
Δ 3 3 4 4 4 6 6 -7
Improvement % -14 -14 -18 -18 -18 -27 -27 -7

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 46 46 46 46 45 45 45 46
Current_run 39 39 39 39 38 35 35 39
Δ -7 -7 -7 -7 -7 -10 -10 -7
Improvement % -15 -15 -15 -15 -16 -22 -22 -7

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 13 16 16 16 16 16 16 46
Current_run 17 18 18 18 18 18 18 39
Δ 4 2 2 2 2 2 2 -7
Improvement % -31 -12 -12 -12 -12 -12 -12 -7

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 46
Current_run 230 230 230 230 230 230 230 39
Δ 0 0 0 0 0 0 0 -7
Improvement % 0 0 0 0 0 0 0 -7

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 297 297 297 297 297 298 298 46
Current_run 349 349 349 349 349 350 350 39
Δ 52 52 52 52 52 52 52 -7
Improvement % -18 -18 -18 -18 -18 -17 -17 -7

TypedFamilyFiveComponents metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 23 23 23 23 23 24 24 44
Current_run 29 29 29 29 30 31 31 35
Δ 6 6 6 6 7 7 7 -9
Improvement % -26 -26 -26 -26 -30 -29 -29 -9

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 23 23 23 23 23 24 24 44
Current_run 29 29 29 29 30 31 31 35
Δ 6 6 6 6 7 7 7 -9
Improvement % -26 -26 -26 -26 -30 -29 -29 -9

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 44 44 44 43 43 42 42 44
Current_run 35 35 35 34 33 33 33 35
Δ -9 -9 -9 -9 -10 -9 -9 -9
Improvement % -20 -20 -20 -21 -23 -21 -21 -9

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 14 16 16 16 16 16 16 44
Current_run 17 18 18 18 18 18 18 35
Δ 3 2 2 2 2 2 2 -9
Improvement % -21 -12 -12 -12 -12 -12 -12 -9

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 44
Current_run 230 230 230 230 230 230 230 35
Δ 0 0 0 0 0 0 0 -9
Improvement % 0 0 0 0 0 0 0 -9

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 314 315 315 315 315 316 316 44
Current_run 390 390 390 390 390 391 391 35
Δ 76 75 75 75 75 75 75 -9
Improvement % -24 -24 -24 -24 -24 -24 -24 -9

TypedFamilyFourComponents metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 23 23 23 23 23 23 23 44
Current_run 27 28 28 28 28 29 29 36
Δ 4 5 5 5 5 6 6 -8
Improvement % -17 -22 -22 -22 -22 -26 -26 -8

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 23 23 23 23 23 23 23 44
Current_run 27 28 28 28 28 29 29 36
Δ 4 5 5 5 5 6 6 -8
Improvement % -17 -22 -22 -22 -22 -26 -26 -8

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 44 44 44 43 43 43 43 44
Current_run 36 36 36 36 36 34 34 36
Δ -8 -8 -8 -7 -7 -9 -9 -8
Improvement % -18 -18 -18 -16 -16 -21 -21 -8

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 14 16 16 16 16 16 16 44
Current_run 17 18 18 18 18 18 18 36
Δ 3 2 2 2 2 2 2 -8
Improvement % -21 -12 -12 -12 -12 -12 -12 -8

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 44
Current_run 230 230 230 230 230 230 230 36
Δ 0 0 0 0 0 0 0 -8
Improvement % 0 0 0 0 0 0 0 -8

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 307 307 307 307 307 307 307 44
Current_run 377 377 377 378 378 378 378 36
Δ 70 70 70 71 71 71 71 -8
Improvement % -23 -23 -23 -23 -23 -23 -23 -8

TypedFamilyOneComponent metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 21 21 21 21 21 22 22 48
Current_run 24 24 24 24 25 25 25 41
Δ 3 3 3 3 4 3 3 -7
Improvement % -14 -14 -14 -14 -19 -14 -14 -7

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 21 21 21 21 21 22 22 48
Current_run 24 24 24 24 25 25 25 41
Δ 3 3 3 3 4 3 3 -7
Improvement % -14 -14 -14 -14 -19 -14 -14 -7

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 48 48 48 48 47 46 46 48
Current_run 41 41 41 41 41 39 39 41
Δ -7 -7 -7 -7 -6 -7 -7 -7
Improvement % -15 -15 -15 -15 -13 -15 -15 -7

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 14 16 16 16 16 16 16 48
Current_run 17 18 18 18 18 18 18 41
Δ 3 2 2 2 2 2 2 -7
Improvement % -21 -12 -12 -12 -12 -12 -12 -7

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 48
Current_run 230 230 230 230 230 230 230 41
Δ 0 0 0 0 0 0 0 -7
Improvement % 0 0 0 0 0 0 0 -7

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 286 286 286 286 286 286 286 48
Current_run 333 333 333 333 333 334 334 41
Δ 47 47 47 47 47 48 48 -7
Improvement % -16 -16 -16 -16 -16 -17 -17 -7

TypedFamilyThreeComponents metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 21 22 22 22 22 22 22 46
Current_run 26 27 27 28 30 34 34 36
Δ 5 5 5 6 8 12 12 -10
Improvement % -24 -23 -23 -27 -36 -55 -55 -10

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 21 22 22 22 22 22 22 46
Current_run 26 27 27 28 29 32 32 36
Δ 5 5 5 6 7 10 10 -10
Improvement % -24 -23 -23 -27 -32 -45 -45 -10

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 47 46 46 46 46 45 45 46
Current_run 38 38 37 35 34 30 30 36
Δ -9 -8 -9 -11 -12 -15 -15 -10
Improvement % -19 -17 -20 -24 -26 -33 -33 -10

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 14 16 16 16 16 16 16 46
Current_run 17 18 18 18 18 18 18 36
Δ 3 2 2 2 2 2 2 -10
Improvement % -21 -12 -12 -12 -12 -12 -12 -10

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 46
Current_run 230 230 230 230 230 230 230 36
Δ 0 0 0 0 0 0 0 -10
Improvement % 0 0 0 0 0 0 0 -10

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 299 299 300 300 300 300 300 46
Current_run 360 361 361 361 362 363 363 36
Δ 61 62 61 61 62 63 63 -10
Improvement % -20 -21 -20 -20 -21 -21 -21 -10

TypedFamilyTwoComponents metrics

Time (wall clock): results within specified thresholds, fold down for details.

Time (wall clock) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 21 21 22 22 22 22 22 47
Current_run 25 27 27 28 31 34 34 36
Δ 4 6 5 6 9 12 12 -11
Improvement % -19 -29 -23 -27 -41 -55 -55 -11

Time (total CPU): results within specified thresholds, fold down for details.

Time (total CPU) (ms) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 21 21 22 22 22 22 22 47
Current_run 25 27 27 27 29 30 30 36
Δ 4 6 5 5 7 8 8 -11
Improvement % -19 -29 -23 -23 -32 -36 -36 -11

Throughput (# / s): results within specified thresholds, fold down for details.

Throughput (# / s) (#) p0 p25 p50 p75 p90 p99 p100 Samples
dev 47 47 46 46 46 46 46 47
Current_run 40 38 37 36 32 30 30 36
Δ -7 -9 -9 -10 -14 -16 -16 -11
Improvement % -15 -19 -20 -22 -30 -35 -35 -11

Memory (resident peak): results within specified thresholds, fold down for details.

Memory (resident peak) (M) p0 p25 p50 p75 p90 p99 p100 Samples
dev 13 16 16 16 16 16 16 47
Current_run 17 18 18 18 18 18 18 36
Δ 4 2 2 2 2 2 2 -11
Improvement % -31 -12 -12 -12 -12 -12 -12 -11

Malloc (total): results within specified thresholds, fold down for details.

Malloc (total) (K) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 230 230 230 230 230 230 230 47
Current_run 230 230 230 230 230 230 230 36
Δ 0 0 0 0 0 0 0 -11
Improvement % 0 0 0 0 0 0 0 -11

Instructions: results within specified thresholds, fold down for details.

Instructions (M) * p0 p25 p50 p75 p90 p99 p100 Samples
dev 293 293 293 293 293 293 293 47
Current_run 347 348 348 348 349 350 350 36
Δ 54 55 55 55 56 57 57 -11
Improvement % -18 -19 -19 -19 -19 -19 -19 -11

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment