gistfile1.txt

_int8da_int8w_api
(2, 1152, 256): elapsed time: 0.3003932762145996, bf16 elapsed time: 0.21411584854125976
(2, 1152, 1152): elapsed time: 0.3486528015136719, bf16 elapsed time: 0.22110015869140626
(2, 6912, 1152): elapsed time: 0.2898115158081055, bf16 elapsed time: 0.20723712921142579
(600, 1152, 4096): elapsed time: 0.27465951919555665, bf16 elapsed time: 0.2206876754760742
(8192, 1152, 1152): elapsed time: 0.3263916778564453, bf16 elapsed time: 0.2734268760681152
(8192, 4608, 1152): elapsed time: 0.6204579162597657, bf16 elapsed time: 0.44056800842285154
(8192, 32, 1152): elapsed time: 0.3365078353881836, bf16 elapsed time: 0.3866156768798828
_int8wo_api
(2, 1152, 256): elapsed time: 0.3044166374206543, bf16 elapsed time: 0.21549856185913085
(2, 1152, 1152): elapsed time: 0.28051200866699216, bf16 elapsed time: 0.21985567092895508
(2, 6912, 1152): elapsed time: 0.26596704483032224, bf16 elapsed time: 0.21135040283203124
(600, 1152, 4096): elapsed time: 0.27939231872558595, bf16 elapsed time: 0.3227414321899414
(8192, 1152, 1152): elapsed time: 0.5811852645874024, bf16 elapsed time: 0.26477760314941406
(8192, 4608, 1152): elapsed time: 0.6176476669311524, bf16 elapsed time: 0.4955401611328125
(8192, 32, 1152): elapsed time: 0.2714633560180664, bf16 elapsed time: 0.2473971176147461
_int4wo_api
(2, 1152, 256): elapsed time: 0.37659038543701173, bf16 elapsed time: 0.23743967056274415
(2, 1152, 1152): elapsed time: 0.3017865562438965, bf16 elapsed time: 0.240545597076416
(2, 6912, 1152): elapsed time: 0.28021247863769533, bf16 elapsed time: 0.22338943481445311
(600, 1152, 4096): elapsed time: 0.41401985168457034, bf16 elapsed time: 0.23454816818237303
(8192, 1152, 1152): elapsed time: 2.571391296386719, bf16 elapsed time: 0.2610038375854492
(8192, 4608, 1152): elapsed time: 9.92913818359375, bf16 elapsed time: 0.44228286743164064
(8192, 32, 1152): elapsed time: 0.3367148971557617, bf16 elapsed time: 0.25003103256225584