Skip to content

Instantly share code, notes, and snippets.

@youngsofun
Last active May 20, 2022 14:26
Show Gist options
  • Save youngsofun/b7a2d3629e53aa6d6cdfb72d82a8a727 to your computer and use it in GitHub Desktop.
Save youngsofun/b7a2d3629e53aa6d6cdfb72d82a8a727 to your computer and use it in GitHub Desktop.
csv: index vs iterator
[6.0826 us 6.1268 us 6.1724 us] 2^10 write_by_row
[9.5422 us 9.6044 us 9.7021 us] write_iterator
[34.306 us 35.018 us 35.743 us] 2^12
[59.263 us 64.474 us 70.274 us]
[258.79 us 274.87 us 292.75 us] 2^14
[268.50 us 299.75 us 336.83 us]
[1.0222 ms 1.0915 ms 1.1700 ms] 2^16
[1.0471 ms 1.1175 ms 1.2005 ms]
[4.3646 ms 4.7908 ms 5.2882 ms] 2^18
[4.0334 ms 4.2695 ms 4.5617 ms]
[17.874 ms 18.891 ms 20.070 ms] 2^20
[17.347 ms 18.257 ms 19.349 ms]
Gnuplot not found, using plotters backend
Benchmarking i32 2^10 not null, write_by_row
Benchmarking i32 2^10 not null, write_by_row: Warming up for 3.0000 s
Benchmarking i32 2^10 not null, write_by_row: Collecting 100 samples in estimated 5.0284 s (813k iterations)
Benchmarking i32 2^10 not null, write_by_row: Analyzing
i32 2^10 not null, write_by_row
time: [6.0826 us 6.1268 us 6.1724 us]
change: [+11.509% +12.441% +13.383%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking i32 2^10 not null, write_iterator
Benchmarking i32 2^10 not null, write_iterator: Warming up for 3.0000 s
Benchmarking i32 2^10 not null, write_iterator: Collecting 100 samples in estimated 5.0282 s (500k iterations)
Benchmarking i32 2^10 not null, write_iterator: Analyzing
i32 2^10 not null, write_iterator
time: [9.5422 us 9.6044 us 9.7021 us]
change: [-2.3389% -1.6086% -0.8754%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low severe
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking i32 2^12 not null, write_by_row
Benchmarking i32 2^12 not null, write_by_row: Warming up for 3.0000 s
Benchmarking i32 2^12 not null, write_by_row: Collecting 100 samples in estimated 5.0744 s (136k iterations)
Benchmarking i32 2^12 not null, write_by_row: Analyzing
i32 2^12 not null, write_by_row
time: [34.306 us 35.018 us 35.743 us]
change: [+1.0534% +3.7724% +6.6185%] (p = 0.01 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking i32 2^12 not null, write_iterator
Benchmarking i32 2^12 not null, write_iterator: Warming up for 3.0000 s
Benchmarking i32 2^12 not null, write_iterator: Collecting 100 samples in estimated 5.1078 s (111k iterations)
Benchmarking i32 2^12 not null, write_iterator: Analyzing
i32 2^12 not null, write_iterator
time: [59.263 us 64.474 us 70.274 us]
change: [+15.176% +24.947% +36.661%] (p = 0.00 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
7 (7.00%) high mild
8 (8.00%) high severe
Benchmarking i32 2^14 not null, write_by_row
Benchmarking i32 2^14 not null, write_by_row: Warming up for 3.0000 s
Benchmarking i32 2^14 not null, write_by_row: Collecting 100 samples in estimated 5.3697 s (20k iterations)
Benchmarking i32 2^14 not null, write_by_row: Analyzing
i32 2^14 not null, write_by_row
time: [258.79 us 274.87 us 292.75 us]
change: [+18.902% +25.750% +32.608%] (p = 0.00 < 0.05)
Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
6 (6.00%) high mild
3 (3.00%) high severe
Benchmarking i32 2^14 not null, write_iterator
Benchmarking i32 2^14 not null, write_iterator: Warming up for 3.0000 s
Benchmarking i32 2^14 not null, write_iterator: Collecting 100 samples in estimated 5.5960 s (20k iterations)
Benchmarking i32 2^14 not null, write_iterator: Analyzing
i32 2^14 not null, write_iterator
time: [268.50 us 299.75 us 336.83 us]
change: [+18.381% +27.628% +39.361%] (p = 0.00 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
4 (4.00%) high mild
11 (11.00%) high severe
Benchmarking i32 2^16 not null, write_by_row
Benchmarking i32 2^16 not null, write_by_row: Warming up for 3.0000 s
Benchmarking i32 2^16 not null, write_by_row: Collecting 100 samples in estimated 9.4740 s (10k iterations)
Benchmarking i32 2^16 not null, write_by_row: Analyzing
i32 2^16 not null, write_by_row
time: [1.0222 ms 1.0915 ms 1.1700 ms]
change: [+7.6991% +11.307% +15.637%] (p = 0.00 < 0.05)
Performance has regressed.
Found 17 outliers among 100 measurements (17.00%)
3 (3.00%) high mild
14 (14.00%) high severe
Benchmarking i32 2^16 not null, write_iterator
Benchmarking i32 2^16 not null, write_iterator: Warming up for 3.0000 s
Benchmarking i32 2^16 not null, write_iterator: Collecting 100 samples in estimated 9.3039 s (10k iterations)
Benchmarking i32 2^16 not null, write_iterator: Analyzing
i32 2^16 not null, write_iterator
time: [1.0471 ms 1.1175 ms 1.2005 ms]
change: [+17.379% +24.950% +35.060%] (p = 0.00 < 0.05)
Performance has regressed.
Found 14 outliers among 100 measurements (14.00%)
4 (4.00%) high mild
10 (10.00%) high severe
Benchmarking i32 2^18 not null, write_by_row
Benchmarking i32 2^18 not null, write_by_row: Warming up for 3.0000 s
Benchmarking i32 2^18 not null, write_by_row: Collecting 100 samples in estimated 5.3194 s (1300 iterations)
Benchmarking i32 2^18 not null, write_by_row: Analyzing
i32 2^18 not null, write_by_row
time: [4.3646 ms 4.7908 ms 5.2882 ms]
change: [+1.8672% +13.687% +26.164%] (p = 0.02 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
2 (2.00%) high mild
13 (13.00%) high severe
Benchmarking i32 2^18 not null, write_iterator
Benchmarking i32 2^18 not null, write_iterator: Warming up for 3.0000 s
Benchmarking i32 2^18 not null, write_iterator: Collecting 100 samples in estimated 5.2607 s (1400 iterations)
Benchmarking i32 2^18 not null, write_iterator: Analyzing
i32 2^18 not null, write_iterator
time: [4.0334 ms 4.2695 ms 4.5617 ms]
change: [+6.8018% +13.416% +20.922%] (p = 0.00 < 0.05)
Performance has regressed.
Found 16 outliers among 100 measurements (16.00%)
4 (4.00%) high mild
12 (12.00%) high severe
Benchmarking i32 2^20 not null, write_by_row
Benchmarking i32 2^20 not null, write_by_row: Warming up for 3.0000 s
Benchmarking i32 2^20 not null, write_by_row: Collecting 100 samples in estimated 5.4324 s (300 iterations)
Benchmarking i32 2^20 not null, write_by_row: Analyzing
i32 2^20 not null, write_by_row
time: [17.874 ms 18.891 ms 20.070 ms]
change: [+17.535% +24.626% +32.002%] (p = 0.00 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
3 (3.00%) high mild
12 (12.00%) high severe
Benchmarking i32 2^20 not null, write_iterator
Benchmarking i32 2^20 not null, write_iterator: Warming up for 3.0000 s
Benchmarking i32 2^20 not null, write_iterator: Collecting 100 samples in estimated 5.6016 s (300 iterations)
Benchmarking i32 2^20 not null, write_iterator: Analyzing
i32 2^20 not null, write_iterator
time: [17.347 ms 18.257 ms 19.349 ms]
change: [+13.447% +19.052% +25.734%] (p = 0.00 < 0.05)
Performance has regressed.
Found 17 outliers among 100 measurements (17.00%)
8 (8.00%) high mild
9 (9.00%) high severe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment