Rani ranihorev

ranihorev / zip_codes_data.json

Created January 22, 2021 03:30

This file has been truncated, but you can view the full file.

ranihorev / maps_geocoding_api_result

Created January 21, 2021 23:16

ranihorev / BPE

Created January 6, 2019 01:07

Byte Pair Encoding example (Source: Sennrich et al. - https://arxiv.org/abs/1508.07909)

	import re, collections

	def get_stats(vocab):
	pairs = collections.defaultdict(int)
	for word, freq in vocab.items():
	symbols = word.split()
	for i in range(len(symbols)-1):
	pairs[symbols[i],symbols[i+1]] += freq
	return pairs

ranihorev / BPE

Created January 6, 2019 01:07

Byte Pair Encoding example (Source: Sennrich et al.)

	import re, collections

	def get_stats(vocab):
	pairs = collections.defaultdict(int)
	for word, freq in vocab.items():
	symbols = word.split()
	for i in range(len(symbols)-1):
	pairs[symbols[i],symbols[i+1]] += freq
	return pairs

ranihorev / Structured_with_text.py

Last active June 24, 2020 05:13

PyTorch module for classification or regression of categorical+continuous+text inputs. This module is based on fast.ai library

	from fastai.text import *
	from fastai.structured import proc_df
	import pandas as pd
	import numpy as np

	class MixedInputModelWithText(nn.Module):
	def __init__(self, emb_szs, n_cont, emb_drop, out_sz, szs, drops,
	y_range=None, use_bn=False, is_reg=True, is_multi=False, n_text=0):
	super().__init__()
	for i, (c, s) in enumerate(emb_szs): assert c > 1, f"cardinality must be >=2, got emb_szs[{i}]: ({c},{s})"

ranihorev / test8

Created August 31, 2017 23:07

0xCe5E7214E74b62F2a1398db5CFb86eF68f8c1EF3

ranihorev / test7

Created August 27, 2017 05:43

0x732d75a4000cB2F38914FC1B6440A9E3753e21f2

ranihorev / test6

Created August 27, 2017 02:04

0x541ea7e288d7344b28903ca862ff9fe3efc8c6cd

ranihorev / gist:481e9158afe411ce331f40ab6d31dd62

Last active August 27, 2017 02:02

0xE837758E2f4A21dd0abd4eC3CA252B5ad352bcB2

ranihorev / test4

Created August 25, 2017 22:38

0xe837758e2f4a21dd0abd4ec3ca252b5ad352bcb2