Skip to content

Instantly share code, notes, and snippets.

@virattt

virattt/rag-reranking-gpt-colbert.ipynb

Last active January 12, 2025 14:05
Show Gist options
  • Save virattt/b140fb4bf549b6125d53aa153dc53be6 to your computer and use it in GitHub Desktop.
Save virattt/b140fb4bf549b6125d53aa153dc53be6 to your computer and use it in GitHub Desktop.
Download ZIP
rag-reranking-gpt-colbert.ipynb
Display the source blob
Display the rendered blob
Raw
rag-reranking-gpt-colbert.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TripleExclam
Copy link

query_embedding = model(**query_encoding).last_hidden_state.squeeze(0) is correct since it returns a vector per token, whilst
query_embedding = model(**query_encoding).last_hidden_state.mean(dim=1) returns a single vector averaged over all tokens.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment