Skip to content

Instantly share code, notes, and snippets.

@fsndzomga

fsndzomga/evals.py

Last active January 28, 2024 01:20
Show Gist options
  • Save fsndzomga/72f25c5d06557be7892bf6e20f06e46c to your computer and use it in GitHub Desktop.
Save fsndzomga/72f25c5d06557be7892bf6e20f06e46c to your computer and use it in GitHub Desktop.
Download ZIP
Raw
evals.py
from dspy.evaluate.evaluate import Evaluate
evaluator = Evaluate(devset=devset, num_threads=1, display_progress=True, display_table=10)
evaluator(compiled_lie_detector, metric=answer_exact_match)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment