Skip to content

Instantly share code, notes, and snippets.

@abhijeet-talaulikar
Last active August 6, 2023 15:16
Show Gist options
  • Save abhijeet-talaulikar/95af9924664c2698b93085e568425ccc to your computer and use it in GitHub Desktop.
Save abhijeet-talaulikar/95af9924664c2698b93085e568425ccc to your computer and use it in GitHub Desktop.
### Query function for the app ###
def get_guery_function(documents):
# Text splitter
text_splitter = RecursiveCharacterTextSplitter(chunk_size=512, chunk_overlap=10)
texts = text_splitter.split_documents(documents)
# Embeddings
embeddings = OpenAIEmbeddings(openai_api_key=openai_api_key)
vectordb = Chroma.from_documents(documents=texts,
embedding=embeddings,
persist_directory=".")
vectordb.persist()
retriever = vectordb.as_retriever(search_kwargs={"k": 3})
# LLM
llm = ChatOpenAI(model_name='gpt-3.5-turbo', openai_api_key=openai_api_key)
# QA object
qa = RetrievalQA.from_chain_type(llm=llm, chain_type="stuff", retriever=retriever)
return qa
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment