Skip to content

Instantly share code, notes, and snippets.

@felixge

felixge/0-note.md

Last active April 11, 2023 04:14
Show Gist options
  • Save felixge/7ad83a76852b703b4adb5e4afefa1d42 to your computer and use it in GitHub Desktop.
Save felixge/7ad83a76852b703b4adb5e4afefa1d42 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
0-note.md

All results are based on my patch against the sweet benchmarks.

  • baseline is HEAD^ with tracing disabled.
  • gentraceback is HEAD^ with tracing enabled (-trace).
  • fpcallers is HEAD with tracing enabled (-trace).
Raw
1-baseline-vs-gentraceback.txt
name old time/op new time/op delta
BiogoIgor 15.4s ± 1% 15.3s ± 1% ~ (p=0.089 n=10+10)
BiogoKrishna 14.7s ± 1% 14.7s ± 1% ~ (p=0.218 n=10+10)
BleveIndexBatch100 5.39s ± 3% 5.44s ± 3% ~ (p=0.353 n=10+10)
BleveQuery 1.77s ± 0% 1.78s ± 0% +0.40% (p=0.000 n=8+10)
FoglemanFauxGLRenderRotateBoat 8.09s ± 0% 8.03s ± 0% -0.70% (p=0.000 n=10+8)
FoglemanPathTraceRenderGopherIter1 21.5s ± 5% 25.9s ± 2% +20.83% (p=0.000 n=10+10)
GoBuildKubelet 33.7s ± 1% 34.4s ± 1% +2.29% (p=0.000 n=9+8)
GoBuildKubeletLink 9.23s ± 1% 9.28s ± 1% ~ (p=0.063 n=9+9)
GoBuildIstioctl 35.4s ± 1% 36.2s ± 1% +2.36% (p=0.000 n=10+10)
GoBuildIstioctlLink 9.60s ± 1% 9.62s ± 1% ~ (p=0.631 n=10+10)
GoBuildFrontend 12.3s ± 1% 12.7s ± 1% +2.69% (p=0.000 n=10+10)
GoBuildFrontendLink 1.46s ± 2% 1.45s ± 1% ~ (p=0.278 n=10+9)
GopherLuaKNucleotide 22.3s ± 1% 22.2s ± 0% -0.44% (p=0.022 n=10+9)
MarkdownRenderXHTML 195ms ± 1% 196ms ± 0% +0.51% (p=0.043 n=10+7)
Tile38WithinCircle100kmRequest 880µs ± 2% 977µs ± 1% +10.93% (p=0.000 n=10+10)
Tile38IntersectsCircle100kmRequest 1.04ms ± 3% 1.15ms ± 1% +10.60% (p=0.000 n=10+10)
Tile38KNearestLimit100Request 858µs ± 1% 858µs ± 2% ~ (p=0.971 n=10+10)
name old average-RSS-bytes new average-RSS-bytes delta
BiogoIgor 68.5MB ± 1% 75.4MB ± 3% +10.05% (p=0.000 n=10+10)
BiogoKrishna 4.30GB ± 0% 4.30GB ± 0% ~ (p=0.393 n=10+10)
BleveIndexBatch100 194MB ± 2% 200MB ± 2% +3.07% (p=0.000 n=10+10)
BleveQuery 534MB ± 0% 535MB ± 0% +0.26% (p=0.000 n=10+7)
FoglemanFauxGLRenderRotateBoat 453MB ± 0% 454MB ± 0% +0.35% (p=0.002 n=10+10)
FoglemanPathTraceRenderGopherIter1 126MB ± 1% 132MB ± 1% +5.37% (p=0.000 n=10+10)
GoBuildKubelet 2.15GB ± 1% 2.26GB ± 1% +4.86% (p=0.000 n=10+10)
GoBuildIstioctl 1.57GB ± 0% 1.66GB ± 1% +6.05% (p=0.000 n=10+10)
GoBuildFrontend 551MB ± 1% 583MB ± 1% +5.83% (p=0.000 n=10+10)
GopherLuaKNucleotide 37.0MB ± 1% 39.9MB ± 1% +7.99% (p=0.000 n=9+9)
MarkdownRenderXHTML 20.7MB ± 3% 22.0MB ± 2% +6.41% (p=0.000 n=10+10)
Tile38WithinCircle100kmRequest 5.26GB ± 1% 5.28GB ± 1% ~ (p=0.356 n=10+9)
Tile38IntersectsCircle100kmRequest 5.58GB ± 2% 5.56GB ± 1% ~ (p=0.529 n=10+10)
Tile38KNearestLimit100Request 7.24GB ± 1% 7.28GB ± 2% ~ (p=0.579 n=10+10)
name old peak-RSS-bytes new peak-RSS-bytes delta
BiogoIgor 95.0MB ± 1% 100.0MB ± 5% +5.25% (p=0.000 n=10+10)
BiogoKrishna 4.48GB ± 0% 4.48GB ± 0% +0.03% (p=0.000 n=10+9)
BleveIndexBatch100 270MB ± 8% 277MB ± 3% +2.57% (p=0.028 n=10+9)
BleveQuery 535MB ± 0% 536MB ± 0% +0.30% (p=0.000 n=9+8)
FoglemanFauxGLRenderRotateBoat 500MB ± 1% 502MB ± 0% +0.46% (p=0.002 n=9+8)
FoglemanPathTraceRenderGopherIter1 163MB ± 0% 183MB ± 1% +12.08% (p=0.000 n=10+9)
GopherLuaKNucleotide 39.7MB ± 4% 43.8MB ± 1% +10.43% (p=0.000 n=10+10)
MarkdownRenderXHTML 21.3MB ± 3% 22.8MB ± 2% +6.69% (p=0.000 n=10+10)
Tile38WithinCircle100kmRequest 5.68GB ± 2% 5.63GB ± 2% ~ (p=0.143 n=10+10)
Tile38IntersectsCircle100kmRequest 5.99GB ± 5% 5.87GB ± 2% -2.09% (p=0.035 n=10+10)
Tile38KNearestLimit100Request 7.55GB ± 0% 7.58GB ± 1% +0.47% (p=0.043 n=10+10)
name old peak-VM-bytes new peak-VM-bytes delta
BiogoIgor 812MB ± 0% 817MB ± 0% +0.70% (p=0.000 n=7+10)
BiogoKrishna 5.24GB ± 0% 5.24GB ± 0% +0.02% (p=0.000 n=9+10)
BleveIndexBatch100 6.65GB ± 1% 6.66GB ± 2% +0.16% (p=0.037 n=10+10)
BleveQuery 3.57GB ± 2% 3.53GB ± 1% ~ (p=0.270 n=10+10)
FoglemanFauxGLRenderRotateBoat 1.22GB ± 0% 1.23GB ± 0% +0.41% (p=0.000 n=10+10)
FoglemanPathTraceRenderGopherIter1 876MB ± 0% 890MB ± 0% +1.63% (p=0.000 n=10+10)
GopherLuaKNucleotide 733MB ± 0% 734MB ± 0% +0.09% (p=0.000 n=10+10)
MarkdownRenderXHTML 733MB ± 0% 734MB ± 0% +0.07% (p=0.000 n=10+7)
Tile38WithinCircle100kmRequest 6.40GB ± 2% 6.33GB ± 2% ~ (p=0.210 n=10+10)
Tile38IntersectsCircle100kmRequest 6.71GB ± 4% 6.58GB ± 1% ~ (p=0.052 n=10+10)
Tile38KNearestLimit100Request 8.26GB ± 0% 8.29GB ± 1% +0.39% (p=0.000 n=10+10)
name old p50-latency-ns new p50-latency-ns delta
Tile38WithinCircle100kmRequest 104k ± 2% 124k ± 2% +19.65% (p=0.000 n=9+9)
Tile38IntersectsCircle100kmRequest 149k ± 4% 176k ± 2% +18.14% (p=0.000 n=10+9)
Tile38KNearestLimit100Request 591k ± 1% 588k ± 3% ~ (p=0.796 n=10+10)
name old p90-latency-ns new p90-latency-ns delta
Tile38WithinCircle100kmRequest 939k ± 2% 1016k ± 1% +8.27% (p=0.000 n=10+10)
Tile38IntersectsCircle100kmRequest 1.19M ± 2% 1.28M ± 2% +7.28% (p=0.000 n=9+10)
Tile38KNearestLimit100Request 1.73M ± 1% 1.72M ± 2% ~ (p=0.631 n=10+10)
name old p99-latency-ns new p99-latency-ns delta
Tile38WithinCircle100kmRequest 12.4M ± 1% 14.3M ± 3% +14.91% (p=0.000 n=7+10)
Tile38IntersectsCircle100kmRequest 14.7M ± 6% 17.5M ± 4% +19.28% (p=0.000 n=10+9)
Tile38KNearestLimit100Request 3.80M ± 3% 3.73M ±10% ~ (p=0.481 n=10+10)
name old ops/s new ops/s delta
Tile38WithinCircle100kmRequest 61.3k ± 2% 55.3k ± 1% -9.86% (p=0.000 n=10+10)
Tile38IntersectsCircle100kmRequest 52.0k ± 3% 47.0k ± 1% -9.59% (p=0.000 n=10+10)
Tile38KNearestLimit100Request 63.0k ± 1% 63.0k ± 2% ~ (p=0.971 n=10+10)
Raw
2-baseline-vs-fpcallers.txt
name old time/op new time/op delta
BiogoIgor 15.4s ± 1% 15.4s ± 1% ~ (p=0.481 n=10+10)
BiogoKrishna 14.7s ± 1% 14.7s ± 1% ~ (p=0.393 n=10+10)
BleveIndexBatch100 5.39s ± 3% 5.47s ± 2% ~ (p=0.165 n=10+10)
BleveQuery 1.77s ± 0% 1.76s ± 0% -0.95% (p=0.000 n=8+9)
FoglemanFauxGLRenderRotateBoat 8.09s ± 0% 8.06s ± 1% ~ (p=0.123 n=10+10)
FoglemanPathTraceRenderGopherIter1 21.5s ± 5% 21.5s ± 9% ~ (p=0.853 n=10+10)
GoBuildKubelet 33.7s ± 1% 34.1s ± 1% +1.40% (p=0.000 n=9+9)
GoBuildKubeletLink 9.23s ± 1% 9.26s ± 0% ~ (p=0.211 n=9+10)
GoBuildIstioctl 35.4s ± 1% 35.7s ± 1% +1.05% (p=0.000 n=10+9)
GoBuildIstioctlLink 9.60s ± 1% 9.59s ± 1% ~ (p=0.853 n=10+10)
GoBuildFrontend 12.3s ± 1% 12.5s ± 1% +1.25% (p=0.000 n=10+9)
GoBuildFrontendLink 1.46s ± 2% 1.45s ± 2% ~ (p=0.400 n=10+9)
GopherLuaKNucleotide 22.3s ± 1% 22.3s ± 0% ~ (p=0.912 n=10+10)
MarkdownRenderXHTML 195ms ± 1% 196ms ± 0% +0.67% (p=0.011 n=10+10)
Tile38WithinCircle100kmRequest 880µs ± 2% 897µs ± 3% +1.82% (p=0.029 n=10+10)
Tile38IntersectsCircle100kmRequest 1.04ms ± 3% 1.06ms ± 3% +2.17% (p=0.004 n=10+10)
Tile38KNearestLimit100Request 858µs ± 1% 847µs ± 1% -1.19% (p=0.000 n=10+9)
name old average-RSS-bytes new average-RSS-bytes delta
BiogoIgor 68.5MB ± 1% 75.3MB ± 3% +9.92% (p=0.000 n=10+10)
BiogoKrishna 4.30GB ± 0% 4.30GB ± 0% ~ (p=0.481 n=10+10)
BleveIndexBatch100 194MB ± 2% 199MB ± 1% +2.60% (p=0.000 n=10+8)
BleveQuery 534MB ± 0% 535MB ± 0% +0.22% (p=0.000 n=10+8)
FoglemanFauxGLRenderRotateBoat 453MB ± 0% 455MB ± 0% +0.47% (p=0.000 n=10+10)
FoglemanPathTraceRenderGopherIter1 126MB ± 1% 131MB ± 0% +4.56% (p=0.000 n=10+9)
GoBuildKubelet 2.15GB ± 1% 2.25GB ± 0% +4.55% (p=0.000 n=10+8)
GoBuildIstioctl 1.57GB ± 0% 1.66GB ± 1% +5.98% (p=0.000 n=10+10)
GoBuildFrontend 551MB ± 1% 576MB ± 1% +4.70% (p=0.000 n=10+10)
GopherLuaKNucleotide 37.0MB ± 1% 39.8MB ± 1% +7.74% (p=0.000 n=9+9)
MarkdownRenderXHTML 20.7MB ± 3% 21.8MB ± 2% +5.73% (p=0.000 n=10+10)
Tile38WithinCircle100kmRequest 5.26GB ± 1% 5.28GB ± 1% ~ (p=0.190 n=10+10)
Tile38IntersectsCircle100kmRequest 5.58GB ± 2% 5.61GB ± 2% ~ (p=0.247 n=10+10)
Tile38KNearestLimit100Request 7.24GB ± 1% 7.23GB ± 1% ~ (p=0.497 n=10+9)
name old peak-RSS-bytes new peak-RSS-bytes delta
BiogoIgor 95.0MB ± 1% 100.0MB ± 4% +5.22% (p=0.000 n=10+10)
BiogoKrishna 4.48GB ± 0% 4.48GB ± 0% +0.02% (p=0.004 n=10+10)
BleveIndexBatch100 270MB ± 8% 277MB ± 8% ~ (p=0.218 n=10+10)
BleveQuery 535MB ± 0% 536MB ± 0% +0.25% (p=0.000 n=9+10)
FoglemanFauxGLRenderRotateBoat 500MB ± 1% 501MB ± 0% +0.35% (p=0.008 n=9+8)
FoglemanPathTraceRenderGopherIter1 163MB ± 0% 171MB ± 1% +4.78% (p=0.000 n=10+10)
GopherLuaKNucleotide 39.7MB ± 4% 43.9MB ± 1% +10.69% (p=0.000 n=10+9)
MarkdownRenderXHTML 21.3MB ± 3% 22.6MB ± 2% +5.81% (p=0.000 n=10+10)
Tile38WithinCircle100kmRequest 5.68GB ± 2% 5.66GB ± 2% ~ (p=0.529 n=10+10)
Tile38IntersectsCircle100kmRequest 5.99GB ± 5% 5.92GB ± 3% ~ (p=0.353 n=10+10)
Tile38KNearestLimit100Request 7.55GB ± 0% 7.56GB ± 0% ~ (p=0.079 n=10+9)
name old peak-VM-bytes new peak-VM-bytes delta
BiogoIgor 812MB ± 0% 817MB ± 0% +0.68% (p=0.000 n=7+10)
BiogoKrishna 5.24GB ± 0% 5.24GB ± 0% +0.01% (p=0.000 n=9+9)
BleveIndexBatch100 6.65GB ± 1% 6.67GB ± 1% +0.38% (p=0.003 n=10+10)
BleveQuery 3.57GB ± 2% 3.56GB ± 0% ~ (p=0.402 n=10+6)
FoglemanFauxGLRenderRotateBoat 1.22GB ± 0% 1.23GB ± 0% +0.41% (p=0.000 n=10+10)
FoglemanPathTraceRenderGopherIter1 876MB ± 0% 883MB ± 0% +0.83% (p=0.000 n=10+10)
GopherLuaKNucleotide 733MB ± 0% 734MB ± 0% +0.09% (p=0.000 n=10+10)
MarkdownRenderXHTML 733MB ± 0% 734MB ± 0% +0.10% (p=0.000 n=10+10)
Tile38WithinCircle100kmRequest 6.40GB ± 2% 6.39GB ± 2% ~ (p=0.529 n=10+10)
Tile38IntersectsCircle100kmRequest 6.71GB ± 4% 6.63GB ± 3% ~ (p=0.481 n=10+10)
Tile38KNearestLimit100Request 8.26GB ± 0% 8.26GB ± 0% +0.05% (p=0.000 n=10+9)
name old p50-latency-ns new p50-latency-ns delta
Tile38WithinCircle100kmRequest 104k ± 2% 108k ± 3% +4.51% (p=0.000 n=9+9)
Tile38IntersectsCircle100kmRequest 149k ± 4% 156k ± 2% +4.86% (p=0.000 n=10+9)
Tile38KNearestLimit100Request 591k ± 1% 570k ± 1% -3.56% (p=0.000 n=10+10)
name old p90-latency-ns new p90-latency-ns delta
Tile38WithinCircle100kmRequest 939k ± 2% 952k ± 3% ~ (p=0.105 n=10+10)
Tile38IntersectsCircle100kmRequest 1.19M ± 2% 1.21M ± 3% +1.63% (p=0.035 n=9+10)
Tile38KNearestLimit100Request 1.73M ± 1% 1.72M ± 3% ~ (p=0.684 n=10+10)
name old p99-latency-ns new p99-latency-ns delta
Tile38WithinCircle100kmRequest 12.4M ± 1% 12.7M ± 3% +2.26% (p=0.009 n=7+8)
Tile38IntersectsCircle100kmRequest 14.7M ± 6% 15.0M ± 3% ~ (p=0.243 n=10+9)
Tile38KNearestLimit100Request 3.80M ± 3% 3.87M ± 2% +2.09% (p=0.008 n=10+9)
name old ops/s new ops/s delta
Tile38WithinCircle100kmRequest 61.3k ± 2% 60.2k ± 3% -1.78% (p=0.029 n=10+10)
Tile38IntersectsCircle100kmRequest 52.0k ± 3% 50.9k ± 2% -2.12% (p=0.004 n=10+10)
Tile38KNearestLimit100Request 63.0k ± 1% 63.7k ± 1% +1.20% (p=0.000 n=10+9)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment