Skip to content

Instantly share code, notes, and snippets.

@faywong

faywong/howto_sqlite_rag.md

Last active October 31, 2024 06:27
Show Gist options
  • Save faywong/ed8fb555f1ca3c5a53b9be1b57c4eef9 to your computer and use it in GitHub Desktop.
Save faywong/ed8fb555f1ca3c5a53b9be1b57c4eef9 to your computer and use it in GitHub Desktop.
Download ZIP
RAG 探索
Raw
howto_sqlite_rag.md

四步

  1. 换上向量数据库： https://github.com/asg017/sqlite-vec?tab=readme-ov-file
  2. 基于 llama 的文本嵌入模型：https://github.com/asg017/sqlite-lembed
  3. 再把这几个整在一起，跑通一个 RAG 查询：https://alexgarcia.xyz/blog/2024/sqlite-vec-stable-release/index.html
  4. 规模化：改造现有数据本地查询，{table} => 平行创建一个 {table-vec} 表。将原有查询升级到 RAG 查询。

性能

应该一般手机上都能跑得动。存量表迁移到嵌入的过程视数据量规模，需要平滑打散下计算量。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment