Skip to content

Instantly share code, notes, and snippets.

@davidmezzetti

davidmezzetti/txtai-checkpoint.py

Created February 19, 2025 22:06
Show Gist options
  • Save davidmezzetti/1caabef472aeda118cccb0701a73ad35 to your computer and use it in GitHub Desktop.
Save davidmezzetti/1caabef472aeda118cccb0701a73ad35 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
txtai-checkpoint.py
from txtai import Embeddings
# Start the indexing run
embeddings = Embeddings(content=True)
embeddings.index(stream(), checkpoint="checkpoint dir")
# Elapsed time ⏳ then ⚡💥🔥
# error, power outage, random failure
# Fix the issue 🧑‍🔧⚙️
# Pick back up where you left off!
embeddings.index(stream(), checkpoint="checkpoint dir")
# 😀 Make it to Happy Hour 🍺🍷🥃 on time!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment