Travis Fischer transitive-bullshit
👋
transitive-bullshit
/ splade.py
Last active
November 6, 2023 02:40
— forked from rileytomasek/splade.py
SPLADE on Modal
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from fastapi.responses import JSONResponse | |
| from modal import Image, Mount, NetworkFileSystem, Secret, Stub, method, web_endpoint | |
| from pydantic import BaseModel | |
| # This is copied from: https://github.com/pinecone-io/examples/blob/2f51ddfd12a08f2963cc2849661fab51afdeedc6/learn/search/semantic-search/sparse/splade/splade-vector-generation.ipynb#L10 | |
| # Which is recommended here: https://docs.pinecone.io/docs/hybrid-search | |
| stub = Stub("splade") | |
| image = Image.debian_slim().pip_install("torch", "transformers") | |
| volume = NetworkFileSystem.persisted("splade-model-cache-vol-gcp", cloud="gcp") |