Skip to content

Instantly share code, notes, and snippets.

View billybonks's full-sized avatar
💭
qq

Sebastien Stettler billybonks

💭
qq
View GitHub Profile
{% for variant in variants %}
{{variant.product_name}} {{ variant.name }} | {{ variant.sku }} | {{ variant.price }} <br />
{% endfor %}
@billybonks
billybonks / hoverable-bar.json
Last active July 9, 2024 05:20
vega-examples
{
"$schema": "https://vega.github.io/schema/vega/v5.json",
"description": "A basic bar chart example, with value labels shown upon pointer hover.",
"width": 400,
"height": 200,
"padding": 5,
"data": [
{
"name": "table",
{
"$schema": "https://vega.github.io/schema/vega/v5.json",
"autosize": { "type": "fit", "resize": true },
"width": 600,
"height": 400,
"data": [
{
"name": "userFilteredData",
"values": [
{
You are an experienced software developer tasked with creating a commit message based on a git diff. Your goal is to produce a clear, concise, and informative commit message.
First, carefully analyze the following git diff:
<git_diff>
diff --git a/.gitattributes b/.gitattributes
index 3f263d62be..f4542e6b25 100644
--- a/.gitattributes
+++ b/.gitattributes
@@ -1,6 +1,9 @@
## Bug: G-Eval assertions with LiteLLM provider do not trigger API calls
### Describe the bug
When using promptfoo with LiteLLM, G-Eval assertions configured to use a LiteLLM provider (referenced by its string ID, e.g., `litellm:gemini-pro`) do not appear to trigger any API calls to the LiteLLM server for the evaluation step.
The initial prompt's response generation call to LiteLLM works correctly, and the call is logged by the LiteLLM server. However, the subsequent G-Eval call is missing from the LiteLLM server logs. This results in the `gradingResult` often being null or showing an error like "No output", indicating that the G-Eval LLM was not invoked.
---
# yaml-language-server: $schema=https://promptfoo.dev/config-schema.json
description: "Custom Provider"
prompts:
- "say {{item}}"
providers:
- id: file://./provider.js
tests:
@billybonks
billybonks / button.css
Last active August 28, 2025 09:00
last button
a.button {
text-decoration: none;
}
.button {
--button-font-color: light-dark(
var(--button-font-color-light, oklch(0.985 0 0)),
var(--button-font-color-dark, oklch(0.2046 0 0))
);
--button-font-size: 1rem;