nalzok

Keybase proof

I hereby claim:

• I am nalzok on github.
• I am nalzok (https://keybase.io/nalzok) on keybase.
• I have a public key ASAMkvIz91IuWXFkdNjPM60KoPTc6dXVpYy6ygbLHJBQLgo

To claim this, I am signing this object:

nalzok

------------
-- Set up --
------------

.print ''
.print '[Set up]'

.open bmk.db

DROP TABLE IF EXISTS candidates;

nalzok

from time import perf_counter

import torch
from flash_attn_time import benchmark_one
from huggingface_hub import snapshot_download
from huggingface_hub.utils._errors import RepositoryNotFoundError


def benchmark():
    for llama in (1, 2):