subhadarship

pommedeterresautee / Makefile

Last active August 19, 2024 13:27

Divide Hugging Face Transformers training times by 2 or more with dynamic padding and uniform length batching

	# required by (\ SHELL COMMANDS \)
	SHELL:=/bin/bash

	VIRT_ENV_FOLDER = ~/.local/share/virtualenvs/xnli
	SOURCE_VIRT_ENV = source $(VIRT_ENV_FOLDER)/bin/activate


	.PHONY: train
	train:
	( \

W4ngatang / download_glue_data.py

Last active May 4, 2025 12:17

Script for downloading data of the GLUE benchmark (gluebenchmark.com)

	''' Script for downloading all GLUE data.

	Note: for legal reasons, we are unable to host MRPC.
	You can either use the version hosted by the SentEval team, which is already tokenized,
	or you can download the original data from (https://download.microsoft.com/download/D/4/6/D46FF87A-F6B9-4252-AA8B-3604ED519838/MSRParaphraseCorpus.msi) and extract the data from it manually.
	For Windows users, you can run the .msi file. For Mac and Linux users, consider an external library such as 'cabextract' (see below for an example).
	You should then rename and place specific files in a folder (see below for an example).

	mkdir MRPC
	cabextract MSRParaphraseCorpus.msi -d MRPC

Tushar-N / pad_packed_demo.py

Last active October 27, 2024 15:17

How to use pad_packed_sequence in pytorch<1.1.0

	import torch
	import torch.nn as nn
	from torch.nn.utils.rnn import pack_padded_sequence, pad_packed_sequence

	seqs = ['gigantic_string','tiny_str','medium_str']

	# make <pad> idx 0
	vocab = ['<pad>'] + sorted(set(''.join(seqs)))

	# make model

rxaviers / gist:7360908

Last active July 12, 2025 20:05

Complete list of github markdown emoji markup

People