Created
October 29, 2024 15:09
-
-
Save jagill/6749248171a1f12fb7c653ff70c5ed42 to your computer and use it in GitHub Desktop.
Arrow-json benchmarks for json-struct-from-list
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jagill@jagill-mbp:~/dev/arrow-rs/arrow-json {git:json-struct-from-list} | |
0 ❯ cargo bench | |
Compiling arrow-json v53.2.0 (/Users/jagill/dev/arrow-rs/arrow-json) | |
Finished `bench` profile [optimized] target(s) in 5.01s | |
Running benches/serde.rs (/Users/jagill/dev/arrow-rs/target/release/deps/serde-ed020bbc465ae604) | |
small_i32 time: [4.7995 µs 4.8038 µs 4.8085 µs] | |
Found 5 outliers among 100 measurements (5.00%) | |
2 (2.00%) high mild | |
3 (3.00%) high severe | |
large_i32 time: [4.9208 µs 5.0424 µs 5.1535 µs] | |
Found 14 outliers among 100 measurements (14.00%) | |
5 (5.00%) high mild | |
9 (9.00%) high severe | |
small_i64 time: [6.5790 µs 6.6604 µs 6.7337 µs] | |
Found 1 outliers among 100 measurements (1.00%) | |
1 (1.00%) high mild | |
medium_i64 time: [6.6152 µs 6.6625 µs 6.6993 µs] | |
Found 31 outliers among 100 measurements (31.00%) | |
18 (18.00%) low severe | |
1 (1.00%) low mild | |
1 (1.00%) high mild | |
11 (11.00%) high severe | |
large_i64 time: [6.3891 µs 6.4689 µs 6.5586 µs] | |
Found 23 outliers among 100 measurements (23.00%) | |
20 (20.00%) low severe | |
1 (1.00%) high mild | |
2 (2.00%) high severe | |
small_f32 time: [7.3425 µs 7.4716 µs 7.6926 µs] | |
Found 17 outliers among 100 measurements (17.00%) | |
4 (4.00%) high mild | |
13 (13.00%) high severe | |
large_f32 time: [7.3363 µs 7.3640 µs 7.3968 µs] | |
Found 17 outliers among 100 measurements (17.00%) | |
17 (17.00%) high severe | |
jagill@jagill-mbp:~/dev/arrow-rs/arrow-json {git:json-struct-from-list} | |
0 ❯ git co master | |
Switched to branch 'master' | |
Your branch is up to date with 'origin/master'. | |
jagill@jagill-mbp:~/dev/arrow-rs/arrow-json {git:master} | |
0 ❯ cargo bench | |
Compiling arrow-json v53.2.0 (/Users/jagill/dev/arrow-rs/arrow-json) | |
Finished `bench` profile [optimized] target(s) in 3.00s | |
Running benches/serde.rs (/Users/jagill/dev/arrow-rs/target/release/deps/serde-ed020bbc465ae604) | |
small_i32 time: [4.6084 µs 4.6137 µs 4.6220 µs] | |
change: [-4.1203% -3.9386% -3.7402%] (p = 0.00 < 0.05) | |
Performance has improved. | |
Found 8 outliers among 100 measurements (8.00%) | |
5 (5.00%) high mild | |
3 (3.00%) high severe | |
large_i32 time: [4.7305 µs 4.7425 µs 4.7573 µs] | |
change: [-2.8656% -1.4303% -0.0885%] (p = 0.05 < 0.05) | |
Change within noise threshold. | |
small_i64 time: [6.4642 µs 6.5507 µs 6.6263 µs] | |
change: [-4.0184% -2.6878% -1.3678%] (p = 0.00 < 0.05) | |
Performance has improved. | |
medium_i64 time: [6.4994 µs 6.5755 µs 6.6460 µs] | |
change: [-1.7889% -0.7913% +0.1432%] (p = 0.13 > 0.05) | |
No change in performance detected. | |
Found 28 outliers among 100 measurements (28.00%) | |
21 (21.00%) low severe | |
1 (1.00%) high mild | |
6 (6.00%) high severe | |
large_i64 time: [6.7316 µs 6.7624 µs 6.7886 µs] | |
change: [+1.2887% +2.0700% +2.8826%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 18 outliers among 100 measurements (18.00%) | |
7 (7.00%) low severe | |
8 (8.00%) low mild | |
1 (1.00%) high mild | |
2 (2.00%) high severe | |
small_f32 time: [7.4943 µs 7.5113 µs 7.5267 µs] | |
change: [+0.0715% +1.3154% +2.1263%] (p = 0.01 < 0.05) | |
Change within noise threshold. | |
Found 4 outliers among 100 measurements (4.00%) | |
4 (4.00%) high mild | |
large_f32 time: [7.3442 µs 7.3779 µs 7.4150 µs] | |
change: [-0.6965% -0.2254% +0.2380%] (p = 0.36 > 0.05) | |
No change in performance detected. | |
Found 14 outliers among 100 measurements (14.00%) | |
3 (3.00%) high mild | |
11 (11.00%) high severe | |
jagill@jagill-mbp:~/dev/arrow-rs/arrow-json {git:master} | |
0 ❯ git co json-struct-from-list | |
Switched to branch 'json-struct-from-list' | |
jagill@jagill-mbp:~/dev/arrow-rs/arrow-json {git:json-struct-from-list} | |
0 ❯ cargo bench | |
Compiling arrow-json v53.2.0 (/Users/jagill/dev/arrow-rs/arrow-json) | |
Finished `bench` profile [optimized] target(s) in 3.10s | |
Running benches/serde.rs (/Users/jagill/dev/arrow-rs/target/release/deps/serde-ed020bbc465ae604) | |
small_i32 time: [4.8735 µs 4.8954 µs 4.9179 µs] | |
change: [+6.9897% +7.3677% +7.7688%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
large_i32 time: [4.8520 µs 4.8713 µs 4.8906 µs] | |
change: [+2.6441% +3.1546% +3.6621%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 12 outliers among 100 measurements (12.00%) | |
5 (5.00%) low mild | |
7 (7.00%) high mild | |
small_i64 time: [6.2102 µs 6.2957 µs 6.3897 µs] | |
change: [-2.3676% -0.8598% +0.6610%] (p = 0.29 > 0.05) | |
No change in performance detected. | |
Found 1 outliers among 100 measurements (1.00%) | |
1 (1.00%) high mild | |
medium_i64 time: [6.1785 µs 6.1954 µs 6.2153 µs] | |
change: [-5.7103% -4.6747% -3.5879%] (p = 0.00 < 0.05) | |
Performance has improved. | |
Found 20 outliers among 100 measurements (20.00%) | |
20 (20.00%) high mild | |
large_i64 time: [6.4590 µs 6.5391 µs 6.6194 µs] | |
change: [-5.8039% -4.8721% -3.7036%] (p = 0.00 < 0.05) | |
Performance has improved. | |
small_f32 time: [7.5835 µs 7.6336 µs 7.6847 µs] | |
change: [+2.0920% +2.5494% +3.0199%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 1 outliers among 100 measurements (1.00%) | |
1 (1.00%) high mild | |
large_f32 time: [7.6369 µs 7.6612 µs 7.6859 µs] | |
change: [+4.0845% +4.5367% +4.9779%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 1 outliers among 100 measurements (1.00%) | |
1 (1.00%) low mild |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment