post /responses/{response_id}/cancel
Cancels a model response with the given ID. Only responses created with
the background parameter set to true can be cancelled.
Learn more.
billybonks
/ whatsapp_template.liquid
Created
April 28, 2021 11:39
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| {% for variant in variants %} | |
| {{variant.product_name}} {{ variant.name }} | {{ variant.sku }} | {{ variant.price }} <br /> | |
| {% endfor %} |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "$schema": "https://vega.github.io/schema/vega/v5.json", | |
| "description": "A basic bar chart example, with value labels shown upon pointer hover.", | |
| "width": 400, | |
| "height": 200, | |
| "padding": 5, | |
| "data": [ | |
| { | |
| "name": "table", |
billybonks
/ broken example
Last active
August 12, 2024 04:01
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "$schema": "https://vega.github.io/schema/vega/v5.json", | |
| "autosize": { "type": "fit", "resize": true }, | |
| "width": 600, | |
| "height": 400, | |
| "data": [ | |
| { | |
| "name": "userFilteredData", | |
| "values": [ | |
| { |
billybonks
/ broken prompt foo
Created
March 19, 2025 12:15
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| You are an experienced software developer tasked with creating a commit message based on a git diff. Your goal is to produce a clear, concise, and informative commit message. | |
| First, carefully analyze the following git diff: | |
| <git_diff> | |
| diff --git a/.gitattributes b/.gitattributes | |
| index 3f263d62be..f4542e6b25 100644 | |
| --- a/.gitattributes | |
| +++ b/.gitattributes | |
| @@ -1,6 +1,9 @@ |
billybonks
/ proper formatting
Created
May 21, 2025 16:17
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## Bug: G-Eval assertions with LiteLLM provider do not trigger API calls | |
| ### Describe the bug | |
| When using promptfoo with LiteLLM, G-Eval assertions configured to use a LiteLLM provider (referenced by its string ID, e.g., `litellm:gemini-pro`) do not appear to trigger any API calls to the LiteLLM server for the evaluation step. | |
| The initial prompt's response generation call to LiteLLM works correctly, and the call is logged by the LiteLLM server. However, the subsequent G-Eval call is missing from the LiteLLM server logs. This results in the `gradingResult` often being null or showing an error like "No output", indicating that the G-Eval LLM was not invoked. | |
| --- |
billybonks
/ promptfooconfig-filter-second-run.yml
Last active
May 23, 2025 07:46
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # yaml-language-server: $schema=https://promptfoo.dev/config-schema.json | |
| description: "Custom Provider" | |
| prompts: | |
| - "say {{item}}" | |
| providers: | |
| - id: file://./provider.js | |
| tests: |
OlderNewer