Skip to content

Instantly share code, notes, and snippets.

@jagill
Created October 29, 2024 15:09
Show Gist options
  • Save jagill/6749248171a1f12fb7c653ff70c5ed42 to your computer and use it in GitHub Desktop.
Save jagill/6749248171a1f12fb7c653ff70c5ed42 to your computer and use it in GitHub Desktop.
Arrow-json benchmarks for json-struct-from-list
jagill@jagill-mbp:~/dev/arrow-rs/arrow-json {git:json-struct-from-list}
0 ❯ cargo bench
Compiling arrow-json v53.2.0 (/Users/jagill/dev/arrow-rs/arrow-json)
Finished `bench` profile [optimized] target(s) in 5.01s
Running benches/serde.rs (/Users/jagill/dev/arrow-rs/target/release/deps/serde-ed020bbc465ae604)
small_i32 time: [4.7995 µs 4.8038 µs 4.8085 µs]
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
large_i32 time: [4.9208 µs 5.0424 µs 5.1535 µs]
Found 14 outliers among 100 measurements (14.00%)
5 (5.00%) high mild
9 (9.00%) high severe
small_i64 time: [6.5790 µs 6.6604 µs 6.7337 µs]
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
medium_i64 time: [6.6152 µs 6.6625 µs 6.6993 µs]
Found 31 outliers among 100 measurements (31.00%)
18 (18.00%) low severe
1 (1.00%) low mild
1 (1.00%) high mild
11 (11.00%) high severe
large_i64 time: [6.3891 µs 6.4689 µs 6.5586 µs]
Found 23 outliers among 100 measurements (23.00%)
20 (20.00%) low severe
1 (1.00%) high mild
2 (2.00%) high severe
small_f32 time: [7.3425 µs 7.4716 µs 7.6926 µs]
Found 17 outliers among 100 measurements (17.00%)
4 (4.00%) high mild
13 (13.00%) high severe
large_f32 time: [7.3363 µs 7.3640 µs 7.3968 µs]
Found 17 outliers among 100 measurements (17.00%)
17 (17.00%) high severe
jagill@jagill-mbp:~/dev/arrow-rs/arrow-json {git:json-struct-from-list}
0 ❯ git co master
Switched to branch 'master'
Your branch is up to date with 'origin/master'.
jagill@jagill-mbp:~/dev/arrow-rs/arrow-json {git:master}
0 ❯ cargo bench
Compiling arrow-json v53.2.0 (/Users/jagill/dev/arrow-rs/arrow-json)
Finished `bench` profile [optimized] target(s) in 3.00s
Running benches/serde.rs (/Users/jagill/dev/arrow-rs/target/release/deps/serde-ed020bbc465ae604)
small_i32 time: [4.6084 µs 4.6137 µs 4.6220 µs]
change: [-4.1203% -3.9386% -3.7402%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
large_i32 time: [4.7305 µs 4.7425 µs 4.7573 µs]
change: [-2.8656% -1.4303% -0.0885%] (p = 0.05 < 0.05)
Change within noise threshold.
small_i64 time: [6.4642 µs 6.5507 µs 6.6263 µs]
change: [-4.0184% -2.6878% -1.3678%] (p = 0.00 < 0.05)
Performance has improved.
medium_i64 time: [6.4994 µs 6.5755 µs 6.6460 µs]
change: [-1.7889% -0.7913% +0.1432%] (p = 0.13 > 0.05)
No change in performance detected.
Found 28 outliers among 100 measurements (28.00%)
21 (21.00%) low severe
1 (1.00%) high mild
6 (6.00%) high severe
large_i64 time: [6.7316 µs 6.7624 µs 6.7886 µs]
change: [+1.2887% +2.0700% +2.8826%] (p = 0.00 < 0.05)
Performance has regressed.
Found 18 outliers among 100 measurements (18.00%)
7 (7.00%) low severe
8 (8.00%) low mild
1 (1.00%) high mild
2 (2.00%) high severe
small_f32 time: [7.4943 µs 7.5113 µs 7.5267 µs]
change: [+0.0715% +1.3154% +2.1263%] (p = 0.01 < 0.05)
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
large_f32 time: [7.3442 µs 7.3779 µs 7.4150 µs]
change: [-0.6965% -0.2254% +0.2380%] (p = 0.36 > 0.05)
No change in performance detected.
Found 14 outliers among 100 measurements (14.00%)
3 (3.00%) high mild
11 (11.00%) high severe
jagill@jagill-mbp:~/dev/arrow-rs/arrow-json {git:master}
0 ❯ git co json-struct-from-list
Switched to branch 'json-struct-from-list'
jagill@jagill-mbp:~/dev/arrow-rs/arrow-json {git:json-struct-from-list}
0 ❯ cargo bench
Compiling arrow-json v53.2.0 (/Users/jagill/dev/arrow-rs/arrow-json)
Finished `bench` profile [optimized] target(s) in 3.10s
Running benches/serde.rs (/Users/jagill/dev/arrow-rs/target/release/deps/serde-ed020bbc465ae604)
small_i32 time: [4.8735 µs 4.8954 µs 4.9179 µs]
change: [+6.9897% +7.3677% +7.7688%] (p = 0.00 < 0.05)
Performance has regressed.
large_i32 time: [4.8520 µs 4.8713 µs 4.8906 µs]
change: [+2.6441% +3.1546% +3.6621%] (p = 0.00 < 0.05)
Performance has regressed.
Found 12 outliers among 100 measurements (12.00%)
5 (5.00%) low mild
7 (7.00%) high mild
small_i64 time: [6.2102 µs 6.2957 µs 6.3897 µs]
change: [-2.3676% -0.8598% +0.6610%] (p = 0.29 > 0.05)
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
medium_i64 time: [6.1785 µs 6.1954 µs 6.2153 µs]
change: [-5.7103% -4.6747% -3.5879%] (p = 0.00 < 0.05)
Performance has improved.
Found 20 outliers among 100 measurements (20.00%)
20 (20.00%) high mild
large_i64 time: [6.4590 µs 6.5391 µs 6.6194 µs]
change: [-5.8039% -4.8721% -3.7036%] (p = 0.00 < 0.05)
Performance has improved.
small_f32 time: [7.5835 µs 7.6336 µs 7.6847 µs]
change: [+2.0920% +2.5494% +3.0199%] (p = 0.00 < 0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
large_f32 time: [7.6369 µs 7.6612 µs 7.6859 µs]
change: [+4.0845% +4.5367% +4.9779%] (p = 0.00 < 0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment