Skip to content

Instantly share code, notes, and snippets.

@gaphex

gaphex/pretraining_data_params.py

Last active May 12, 2019 08:10
Show Gist options
  • Save gaphex/db79ca66edea368e4334d34cf90b214b to your computer and use it in GitHub Desktop.
Save gaphex/db79ca66edea368e4334d34cf90b214b to your computer and use it in GitHub Desktop.
Download ZIP
Raw
pretraining_data_params.py
MAX_SEQ_LENGTH = 128 #@param {type:"integer"}
MASKED_LM_PROB = 0.15 #@param
MAX_PREDICTIONS = 20 #@param {type:"integer"}
DO_LOWER_CASE = True #@param {type:"boolean"}
PRETRAINING_DIR = "pretraining_data" #@param {type:"string"}
# controls how many parallel processes xargs can create
PROCESSES = 2 #@param {type:"integer"}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment