Here we explore prompt chaining with local reasoning models in combination with base models. With shockingly powerful local models like QwQ and Qwen, we can build some powerful prompt chains that let us tap into their capabilities in a immediately useful, local, private, AND free way.
Explore the idea of building prompt chains where the first is a powerful reasoning model that generates a response, and then use a base model to extract the response.
Play with the prompts and models to see what works best for your use cases. Use the o1 series to see how qwq compares.
- Bun (to run
bun run chain.ts ...
)