A clean installation of Ubuntu 18.04.02 LTS was used.
This gist is an extension to the official docs, adding missing parts and instructions.
follow the pre-installation actions on:
| ''' Script for downloading all GLUE data. | |
| Note: for legal reasons, we are unable to host MRPC. | |
| You can either use the version hosted by the SentEval team, which is already tokenized, | |
| or you can download the original data from (https://download.microsoft.com/download/D/4/6/D46FF87A-F6B9-4252-AA8B-3604ED519838/MSRParaphraseCorpus.msi) and extract the data from it manually. | |
| For Windows users, you can run the .msi file. For Mac and Linux users, consider an external library such as 'cabextract' (see below for an example). | |
| You should then rename and place specific files in a folder (see below for an example). | |
| mkdir MRPC | |
| cabextract MSRParaphraseCorpus.msi -d MRPC |
| #!/bin/bash | |
| ### steps #### | |
| # Verify the system has a cuda-capable gpu | |
| # Download and install the nvidia cuda toolkit and cudnn | |
| # Setup environmental variables | |
| # Verify the installation | |
| ### | |
| ### to verify your gpu is cuda enable check |
| iter_ = 0 | |
| best_error = 0 | |
| best_iter = 0 | |
| best_model = None | |
| col_sample_rates = [0.1, 0.5, 0.9] | |
| subsamples = [0.1, 0.5, 0.9] | |
| etas = [0.01, 0.001] | |
| max_depths = [3, 6, 12, 15, 18] | |
| reg_alphas = [0.01, 0.001] |
A clean installation of Ubuntu 18.04.02 LTS was used.
This gist is an extension to the official docs, adding missing parts and instructions.
follow the pre-installation actions on:
| class Ralamb(Optimizer): | |
| def __init__(self, params, lr=1e-3, betas=(0.9, 0.999), eps=1e-8, weight_decay=0): | |
| defaults = dict(lr=lr, betas=betas, eps=eps, weight_decay=weight_decay) | |
| self.buffer = [[None, None, None] for ind in range(10)] | |
| super(Ralamb, self).__init__(params, defaults) | |
| def __setstate__(self, state): | |
| super(Ralamb, self).__setstate__(state) |
| cd /tmp | |
| wget https://dl.google.com/go/go1.11.linux-amd64.tar.gz | |
| sudo tar -xvf go1.11.linux-amd64.tar.gz | |
| sudo mv go /usr/local | |
| export GOROOT=/usr/local/go | |
| export GOPATH=$HOME/go | |
| export PATH=$GOPATH/bin:$GOROOT/bin:$PATH | |
| source ~/.profile | |
| go version |
| #Use global flag | |
| pip install gensim config --global http.sslVerify false | |
| #on conda, disable the ssl | |
| conda config --set ssl_verify False | |
| conda update conda | |
| # while downloading anything | |
| import ssl |
| { | |
| "Dataset": [ | |
| "multimedqa", | |
| "medmcqa", | |
| "medqa_4options", | |
| "mmlu_anatomy", | |
| "mmlu_clinical_knowledge", | |
| "mmlu_college_biology", | |
| "mmlu_college_medicine", | |
| "mmlu_medical_genetics", |
| #!/usr/bin/env ruby | |
| # https://asmirnov.xyz/vram | |
| # https://vram.asmirnov.xyz | |
| require "fileutils" | |
| require "json" | |
| require "open-uri" | |
| # https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator/blob/main/index.html |