mshojaei77
/ ollama_rag.py
Last active
March 22, 2025 09:37
This Python script processes PDF files from a knowledge base, generates embeddings using OllamaEmbeddings, stores them with FAISS, and performs similarity searches to answer queries, leveraging Langchain's text splitting and LLM capabilities for efficient information retrieval.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from pathlib import Path | |
| import hashlib | |
| from PyPDF2 import PdfReader | |
| import time | |
| from dataclasses import dataclass | |
| from typing import List, Optional | |
| from langchain.text_splitter import RecursiveCharacterTextSplitter | |
| from langchain_community.embeddings import OllamaEmbeddings | |
| from langchain_community.vectorstores import FAISS |