Skip to content

Instantly share code, notes, and snippets.

@simonholm
Created April 16, 2025 06:30
Show Gist options
  • Save simonholm/30b634646ade425f9d3d7eb551195d1f to your computer and use it in GitHub Desktop.
Save simonholm/30b634646ade425f9d3d7eb551195d1f to your computer and use it in GitHub Desktop.
Checklist for verifying AI-generated summaries

Source Consistency Checklist for AI Summaries

Use this checklist to verify that AI-generated summaries align with the original source content:

1. Coverage

  • Are all key points from the source included?
  • Are any important ideas or sections missing?

2. Simplification

  • Is the summary too vague or overly general?
  • Does it preserve necessary detail and nuance?

3. Author Intent

  • Is the tone (e.g., critical, humorous, cautious) faithfully represented?
  • Has the message been reframed inaccurately?

4. External Inference

  • Does the summary avoid adding outside knowledge not present in the text?
  • Are speculative additions clearly labeled or avoided?

5. Interpretation of Ambiguity

  • Are ambiguous or hedged statements treated accurately?
  • Is uncertainty in the source preserved or overstated?

6. Accuracy Flags

  • Are numbers, names, and facts cited correctly?
  • Is anything misleading or contradicted by the original?

Use this checklist especially when summarizing:

  • Opinion pieces
  • Scientific or technical writing
  • Philosophical or economic arguments
  • Articles with layered tone or satire
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment