Skip to content

Instantly share code, notes, and snippets.

View raghu-ramesha's full-sized avatar
💭
I may be slow to respond.

Raghu Ramesha raghu-ramesha

💭
I may be slow to respond.
View GitHub Profile
@raghu-ramesha
raghu-ramesha / configpb.txt
Created February 14, 2023 00:04
fil_backend_config
USE_GPU = True
FIL_MODEL_DIR = "./model_repository/fil"
# Maximum size in bytes for input and output arrays. If you are
# using Triton 21.11 or higher, all memory allocations will make
# use of Triton's memory pool, which has a default size of
# 67_108_864 bytes
MAX_MEMORY_BYTES = 60_000_000
NUM_FEATURES = 15
NUM_CLASSES = 2
@raghu-ramesha
raghu-ramesha / create_prep_env.sh
Created February 13, 2023 23:56
create_prep_env.sh
#!/bin/bash
conda create -y -n preprocessing_env python=3.8
source /opt/conda/etc/profile.d/conda.sh
conda activate preprocessing_env
export PYTHONNOUSERSITE=True
conda install -y -c conda-forge pandas scikit-learn
pip install conda-pack
conda-pack
@raghu-ramesha
raghu-ramesha / config.pbtxt
Created February 13, 2023 23:50
config.pbtxt
name: "preprocessing"
backend: "python"
max_batch_size: 882352
input [
{
name: "User"
data_type: TYPE_FP32
dims: [ 1 ]
},
{