gistfile1.txt

_int8da_int8w_api
(2, 1152, 256): elapsed time: 0.2791945648193359, bf16 elapsed time: 0.3701180648803711
(2, 1152, 1152): elapsed time: 0.31040128707885745, bf16 elapsed time: 0.3642512130737305
(2, 6912, 1152): elapsed time: 0.2989423942565918, bf16 elapsed time: 0.3584345626831055
(600, 1152, 4096): elapsed time: 0.31704416275024416, bf16 elapsed time: 0.344552001953125
(8192, 1152, 1152): elapsed time: 0.3063484764099121, bf16 elapsed time: 0.3529404830932617
(8192, 4608, 1152): elapsed time: 0.2982643127441406, bf16 elapsed time: 0.36193439483642575
(8192, 32, 1152): elapsed time: 0.30923904418945314, bf16 elapsed time: 0.35560993194580076
_int8wo_api
(2, 1152, 256): elapsed time: 0.31670495986938474, bf16 elapsed time: 0.35319679260253906
(2, 1152, 1152): elapsed time: 0.3273567962646484, bf16 elapsed time: 0.3721027374267578
(2, 6912, 1152): elapsed time: 0.30103263854980467, bf16 elapsed time: 0.39612255096435545
(600, 1152, 4096): elapsed time: 0.2873619270324707, bf16 elapsed time: 0.35754177093505857
(8192, 1152, 1152): elapsed time: 0.31485919952392577, bf16 elapsed time: 0.36657855987548826
(8192, 4608, 1152): elapsed time: 0.27997024536132814, bf16 elapsed time: 0.3559142303466797
(8192, 32, 1152): elapsed time: 0.27950111389160154, bf16 elapsed time: 0.342655029296875
_int4wo_api
(2, 1152, 256): elapsed time: 0.29389888763427735, bf16 elapsed time: 0.36621086120605467
(2, 1152, 1152): elapsed time: 0.29352607727050783, bf16 elapsed time: 0.3578812789916992
(2, 6912, 1152): elapsed time: 0.2876140785217285, bf16 elapsed time: 0.36323745727539064
(600, 1152, 4096): elapsed time: 0.3728441619873047, bf16 elapsed time: 0.3771273422241211
(8192, 1152, 1152): elapsed time: 0.30319040298461913, bf16 elapsed time: 0.37172191619873046
(8192, 4608, 1152): elapsed time: 0.2964863967895508, bf16 elapsed time: 0.35174816131591796
(8192, 32, 1152): elapsed time: 0.2925059127807617, bf16 elapsed time: 0.36274112701416017