Last active
November 10, 2025 12:34
-
-
Save wassname/356c24d5c886163bf13751a72fcb7980 to your computer and use it in GitHub Desktop.
problem: model.generate does not return input logprobs, solution `model.forward`, then `model.generate(past_key_values)`, also get logprobs on the last token of a stopping sequences
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment