Skip to content

Instantly share code, notes, and snippets.

@davidberard98
Last active April 19, 2022 21:01
Show Gist options
  • Save davidberard98/6fd634e42f4a1e0fdfa83cfe73d3e0cf to your computer and use it in GitHub Desktop.
Save davidberard98/6fd634e42f4a1e0fdfa83cfe73d3e0cf to your computer and use it in GitHub Desktop.
nvfuser microbenchmark results from apr19
name eager (ms) nnc static (ms) nnc dynamic (ms) nvfuser
autogen-0 0.290 0.281 0.283 0.279
autogen-1 0.177 0.176 0.176 0.175
autogen-2 0.489 0.464 0.491 0.276
autogen-3 4.090 0.875 0.919 1.002
batchnorm-silu 0.289 0.285 0.285 0.221
autogen-4 0.372 0.372 0.368 0.431
autogen-5 0.599 0.597 0.619 0.313
autogen-6 5.152 1.212 1.169 1.384
autogen-7 0.185 0.185 0.183 0.184
autogen-8 0.376 0.188 0.212 0.254
autogen-9 0.136 0.134 0.133 0.131
autogen-10 0.163 0.160 0.158 0.155
autogen-11 0.208 0.209 0.206 0.208
autogen-12 0.192 0.138 0.176 0.196
autogen-13 0.360 0.356 0.350 0.347
autogen-14 1.485 1.448 1.373 1.517
batchnorm-silu-mean 0.382 0.376 0.372 0.250
autogen-15 0.230 0.224 0.223 0.223
autogen-16 0.230 0.225 0.223 0.229
autogen-17 0.470 0.349 0.414 0.252
autogen-18 0.295 0.289 0.288 0.328
autogen-19 0.306 0.304 0.307 0.359
autogen-20 0.449 0.423 0.455 0.270
autogen-21 0.329 0.313 0.333 0.326
autogen-22 1.324 0.470 0.445 0.565
autogen-23 0.322 0.315 0.310 0.312
autogen-24 0.528 0.200 0.234 0.266
autogen-25 0.435 0.280 0.299 0.254
autogen-26 1.181 1.181 1.180 1.181
autogen-27 0.376 0.371 0.380 0.449
autogen-28 0.304 0.295 0.320 0.313
autogen-29 0.406 0.398 0.395 0.400
autogen-30 0.283 0.281 0.279 0.326
autogen-31 0.099 0.096 0.097 0.096
autogen-32 0.202 0.198 0.202 0.197
autogen-33 0.389 0.259 0.286 26.137
autogen-34 0.380 0.389 0.390 0.448
autogen-35 0.536 0.372 0.424 0.278
autogen-36 0.495 0.482 0.483 0.436
autogen-37 0.341 0.196 0.233 0.261
autogen-38 0.260 0.264 0.270 0.266
autogen-39 0.447 0.317 0.379 0.208
autogen-40 0.623 0.597 0.621 0.310
autogen-41 0.151 0.148 0.148 0.149
autogen-42 0.612 0.312 0.341 0.375
autogen-43 0.781 0.715 0.729 0.354
autogen-44 0.388 0.385 0.370 0.213
autogen-45 0.741 0.412 0.448 0.443
autogen-46 0.927 0.310 0.347 0.377
autogen-47 0.222 0.218 0.215 0.212
autogen-48 0.500 0.378 0.452 0.304
autogen-49 0.442 0.371 0.399 0.299
autogen-50 0.185 0.183 0.181 0.182
autogen-51 0.439 0.306 0.345 0.322
autogen-52 0.774 0.739 0.751 0.357
autogen-53 0.693 0.415 0.446 0.444
autogen-54 0.227 0.220 0.223 0.184
autogen-55 0.578 0.440 0.485 0.370
autogen-56 0.391 0.382 0.383 0.447
autogen-57 0.175 0.168 0.168 0.170
autogen-59 0.275 0.255 0.287 0.311
autogen-60 0.471 0.364 0.391 0.276
autogen-61 0.290 0.292 0.290 0.285
autogen-62 0.578 0.555 0.584 0.303
autogen-63 0.455 0.434 0.476 0.497
autogen-64 0.419 0.167 0.187 0.239
autogen-65 0.246 0.246 0.246 0.246
autogen-66 0.296 0.284 0.287 0.333
autogen-67 0.441 0.309 0.348 0.332
autogen-68 0.349 0.329 0.356 0.351
autogen-69 0.440 0.305 0.325 25.600
autogen-70 0.185 0.182 0.182 0.184
autogen-71 0.430 0.326 0.356 0.236
autogen-72 0.274 0.253 0.285 0.264
autogen-73 1.129 0.401 1.330 0.579
autogen-74 0.217 0.156 0.199 0.220
autogen-75 0.412 0.268 0.305 0.291
autogen-76 0.188 0.185 0.187 0.183
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment