Last active
July 8, 2025 23:35
-
-
Save awni/773e2a12079da40a1cbc566686c84c8f to your computer and use it in GitHub Desktop.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
remove the tokenizer from there and use train_dataset=CacheDataset(ds_train),
val_dataset=CacheDataset(ds_valid),