This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| {% for variant in variants %} | |
| {{variant.product_name}} {{ variant.name }} | {{ variant.sku }} | {{ variant.price }} <br /> | |
| {% endfor %} |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "$schema": "https://vega.github.io/schema/vega/v5.json", | |
| "description": "A basic bar chart example, with value labels shown upon pointer hover.", | |
| "width": 400, | |
| "height": 200, | |
| "padding": 5, | |
| "data": [ | |
| { | |
| "name": "table", |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "$schema": "https://vega.github.io/schema/vega/v5.json", | |
| "autosize": { "type": "fit", "resize": true }, | |
| "width": 600, | |
| "height": 400, | |
| "data": [ | |
| { | |
| "name": "userFilteredData", | |
| "values": [ | |
| { |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| You are an experienced software developer tasked with creating a commit message based on a git diff. Your goal is to produce a clear, concise, and informative commit message. | |
| First, carefully analyze the following git diff: | |
| <git_diff> | |
| diff --git a/.gitattributes b/.gitattributes | |
| index 3f263d62be..f4542e6b25 100644 | |
| --- a/.gitattributes | |
| +++ b/.gitattributes | |
| @@ -1,6 +1,9 @@ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ## Bug: G-Eval assertions with LiteLLM provider do not trigger API calls | |
| ### Describe the bug | |
| When using promptfoo with LiteLLM, G-Eval assertions configured to use a LiteLLM provider (referenced by its string ID, e.g., `litellm:gemini-pro`) do not appear to trigger any API calls to the LiteLLM server for the evaluation step. | |
| The initial prompt's response generation call to LiteLLM works correctly, and the call is logged by the LiteLLM server. However, the subsequent G-Eval call is missing from the LiteLLM server logs. This results in the `gradingResult` often being null or showing an error like "No output", indicating that the G-Eval LLM was not invoked. | |
| --- |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # yaml-language-server: $schema=https://promptfoo.dev/config-schema.json | |
| description: "Custom Provider" | |
| prompts: | |
| - "say {{item}}" | |
| providers: | |
| - id: file://./provider.js | |
| tests: |
OlderNewer