Skip to content

Instantly share code, notes, and snippets.

@ThilinaRajapakse

ThilinaRajapakse/eval_mt5_1.py

Last active January 3, 2021 20:08
Show Gist options
  • Save ThilinaRajapakse/cff3bb639e52519fe015276e3020b24e to your computer and use it in GitHub Desktop.
Save ThilinaRajapakse/cff3bb639e52519fe015276e3020b24e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
eval_mt5_1.py
import logging
import sacrebleu
import pandas as pd
from simpletransformers.t5 import T5Model, T5Args
logging.basicConfig(level=logging.INFO)
transformers_logger = logging.getLogger("transformers")
transformers_logger.setLevel(logging.WARNING)
model_args = T5Args()
model_args.max_length = 512
model_args.length_penalty = 1
model_args.num_beams = 10
model = T5Model("mt5", "outputs", args=model_args)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment