Skip to content

Instantly share code, notes, and snippets.

View itsvaibhav01's full-sized avatar
🎯
Focusing

Vaibhav Singh itsvaibhav01

🎯
Focusing
  • IIT Bombay
  • Tokyo
View GitHub Profile
@itsvaibhav01
itsvaibhav01 / thinkretrieve-retrieval-timing.md
Created September 5, 2026 19:23
When should a local RAG agent retrieve? A six-case walkthrough — ThinkRetrieve local-model tutorial

When should a local RAG agent retrieve? A six-case walkthrough

By Vaibhav Singh, a coauthor of ThinkRetrieve. Published September 6, 2026. Prepared with AI assistance from the project documentation and saved experiment records.

A retrieval query can change after a model starts reasoning. That is the practical idea behind ThinkRetrieve: ask for an interim answer, use it together with the original question to retrieve a worked solution, and then let the model continue with that example.

This post walks through a small local-model demonstration. It uses six paraphrases of one synthetic incident, selected after exploratory screening. These are development examples, not a held-out benchmark.

The task: remember the right procedure