Sandy4321
Sandy4321
/ compress.py
Created
May 25, 2023 21:24
— forked from avidale/compress.py
Compress fasttext model by applying denser ngram hash
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # based on Andrey Vasnetsov code: https://gist.github.com/generall/68fddb87ae1845d6f54c958ed3d0addb | |
| import os | |
| import numpy as np | |
| import gensim | |
| from collections import defaultdict | |
| from copy import deepcopy | |
| from gensim.models.utils_any2vec import ft_ngram_hashes | |
| from tqdm.auto import tqdm, trange |
Sandy4321
/ logs.txt
Created
May 25, 2023 21:24
— forked from avidale/logs.txt
This file has been truncated, but you can view the full file.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| повторение мать учения | |
| нет | |
| настанет час | |
| давай | |
| 1 шаг | |
| повторить | |
| потехе час | |
| да | |
| а дома лучше | |
| играем |
Sandy4321
/ inequality-constraints-in-linear-regression.ipynb
Created
May 25, 2023 21:24
— forked from avidale/inequality-constraints-in-linear-regression.ipynb
inequality constraints in linear regression.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sandy4321
/ parametrics.py
Created
May 25, 2023 21:23
— forked from avidale/parametrics.py
parametrics
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from transformers import AutoModel, AutoTokenizer | |
| from transformers import AutoModelForCausalLM | |
| import torch | |
| import torch.nn.functional | |
| from tqdm.auto import tqdm | |
| from nltk.translate.bleu_score import sentence_bleu | |
| import pandas as pd | |
| import numpy as np | |
Sandy4321
/ evaluate_rubert-tiny.ipynb
Created
May 25, 2023 21:23
— forked from avidale/evaluate_rubert-tiny.ipynb
evaluate_rubert-tiny.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sandy4321
/ rubert-tiny.ipynb
Created
May 25, 2023 21:23
— forked from avidale/rubert-tiny.ipynb
rubert-tiny
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sandy4321
/ rut5-encoder.ipynb
Created
May 25, 2023 21:23
— forked from avidale/rut5-encoder.ipynb
rut5-encoder.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sandy4321
/ create_rut5-base.ipynb
Created
May 25, 2023 21:23
— forked from avidale/create_rut5-base.ipynb
create_rut5-base.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sandy4321
/ micro_segments.ipynb
Created
May 25, 2023 21:23
— forked from avidale/micro_segments.ipynb
micro_segments.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sandy4321
/ fsmtforconditionalgeneration.ipynb
Created
May 25, 2023 21:23
— forked from avidale/fsmtforconditionalgeneration.ipynb
Translation_Attention.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.