Skip to content

Instantly share code, notes, and snippets.

@noperator
noperator / hashes.txt
Created November 5, 2025 22:05
records
f11f0d801749022e38c2e0d331f34080fa959f2905103b1029d67fbeb7c21d48

In fruits.py, the model is allowed to generate normally until it emits </think>. Our vLLM request specifies response_format={"type": "structural_tag", ...} so that </think> acts as the boundary where constrained decoding begins.

The relevant part is:

END = "ekYyhUMDCGhE65J5"

response_format={