Skip to content

Instantly share code, notes, and snippets.

@oliverbarnes

oliverbarnes/gist:dcf65c3a04dffb2709126ab4a9250569

Created April 14, 2025 14:27
Show Gist options
  • Save oliverbarnes/dcf65c3a04dffb2709126ab4a9250569 to your computer and use it in GitHub Desktop.
Save oliverbarnes/dcf65c3a04dffb2709126ab4a9250569 to your computer and use it in GitHub Desktop.
Download ZIP
Failed ui tests
Raw
gistfile1.txt
➜ e2e_tests git:(new-function-description-field) ✗ pnpm test
> tensorzero-ui@ test /Users/oliver/Repos/tensorzero/ui
> vitest
DEV v3.1.1 /Users/oliver/Repos/tensorzero/ui
stderr | app/utils/supervised_fine_tuning/openAITokenCounter.test.ts > openAITokenCounter > getTokensFromMessages > should count tokens for basic messages
Warning: gpt-3.5-turbo is not a current version. Using default token counts.
❯ app/utils/clickhouse/function.test.ts (12 tests | 12 failed) 124ms
× getVariantPerformances > getVariantPerformances for extract_entities 24ms
→ Database tensorzero does not exist.
× getVariantPerformances > getVariantPerformances for write_haiku 11ms
→ Database tensorzero does not exist.
× getVariantPerformances > getVariantPerformances for ask_question and solved 8ms
→ Database tensorzero does not exist.
× getVariantPerformances > getVariantPerformances for ask_question and num_questions 9ms
→ Database tensorzero does not exist.
× getVariantPerformances with variant filtering > getVariantPerformances for extract_entities with specific variant 9ms
→ Database tensorzero does not exist.
× getVariantPerformances with variant filtering > getVariantPerformances for write_haiku with specific variant 7ms
→ Database tensorzero does not exist.
× getVariantPerformances with variant filtering > getVariantPerformances for ask_question and solved with specific variant 8ms
→ Database tensorzero does not exist.
× getVariantPerformances with variant filtering > getVariantPerformances for ask_question and num_questions with specific variant 7ms
→ Database tensorzero does not exist.
× getVariantPerformances with variant filtering > getVariantPerformances for non-existent metric 8ms
→ Database tensorzero does not exist.
× getVariantCounts > getVariantCounts for extract_entities 7ms
→ Database tensorzero does not exist.
× getVariantCounts > getVariantCounts for write_haiku 19ms
→ Database tensorzero does not exist.
× getUsedVariants > getUsedVariants for extract_entities 5ms
→ Database tensorzero does not exist.
stderr | app/utils/supervised_fine_tuning/openAITokenCounter.test.ts > openAITokenCounter > getTokensFromMessages > should handle messages with name field
Warning: gpt-4 is not a current version. Using default token counts.
stderr | app/utils/clickhouse/feedback.test.ts > queryCommentFeedbackByTargetId
ClickHouseError: Database tensorzero does not exist.
at parseError (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12)
at ClientRequest.onResponse (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30)
at processTicksAndRejections (node:internal/process/task_queues:105:5) {
code: '81',
type: 'UNKNOWN_DATABASE'
}
stderr | app/utils/supervised_fine_tuning/openAITokenCounter.test.ts > openAITokenCounter > getTokensFromMessages > should handle empty messages
Warning: gpt-3.5-turbo is not a current version. Using default token counts.
stderr | app/utils/clickhouse/feedback.test.ts > queryFeedbackBoundsByTargetId
ClickHouseError: Database tensorzero does not exist.
at parseError (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12)
at ClientRequest.onResponse (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30)
at processTicksAndRejections (node:internal/process/task_queues:105:5) {
code: '81',
type: 'UNKNOWN_DATABASE'
}
stderr | app/utils/clickhouse/feedback.test.ts > queryFeedbackByTargetId
ClickHouseError: Database tensorzero does not exist.
at parseError (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12)
at ClientRequest.onResponse (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30)
at processTicksAndRejections (node:internal/process/task_queues:105:5) {
code: '81',
type: 'UNKNOWN_DATABASE'
}
stderr | app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns correct feedback counts for different metric types
ClickHouseError: Database tensorzero does not exist.
at parseError (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12)
at ClientRequest.onResponse (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30)
at processTicksAndRejections (node:internal/process/task_queues:105:5) {
code: '81',
type: 'UNKNOWN_DATABASE'
}
stderr | app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns correct feedback counts for different metric types
ClickHouseError: Database tensorzero does not exist.
at parseError (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12)
at ClientRequest.onResponse (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30)
at processTicksAndRejections (node:internal/process/task_queues:105:5) {
code: '81',
type: 'UNKNOWN_DATABASE'
}
stderr | app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns correct feedback counts for different metric types
ClickHouseError: Database tensorzero does not exist.
at parseError (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12)
at ClientRequest.onResponse (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30)
at processTicksAndRejections (node:internal/process/task_queues:105:5) {
code: '81',
type: 'UNKNOWN_DATABASE'
}
stderr | app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns correct feedback counts for different metric types
Error fetching metrics with feedback: ClickHouseError: Database tensorzero does not exist.
at parseError (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12)
at ClientRequest.onResponse (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30)
at processTicksAndRejections (node:internal/process/task_queues:105:5) {
code: '81',
type: 'UNKNOWN_DATABASE'
}
stderr | app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns empty array for nonexistent function
Error fetching metrics with feedback: ClickHouseError: Database tensorzero does not exist.
at parseError (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12)
at ClientRequest.onResponse (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30)
at processTicksAndRejections (node:internal/process/task_queues:105:5) {
code: '81',
type: 'UNKNOWN_DATABASE'
}
stderr | app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns correct metrics for both inference and episode levels
Error fetching metrics with feedback: ClickHouseError: Database tensorzero does not exist.
at parseError (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12)
at ClientRequest.onResponse (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30)
at processTicksAndRejections (node:internal/process/task_queues:105:5) {
code: '81',
type: 'UNKNOWN_DATABASE'
}
stderr | app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns correct feedback counts for variant
Error fetching metrics with feedback: ClickHouseError: Database tensorzero does not exist.
at parseError (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12)
at ClientRequest.onResponse (/Users/oliver/Repos/tensorzero/ui/node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30)
at processTicksAndRejections (node:internal/process/task_queues:105:5) {
code: '81',
type: 'UNKNOWN_DATABASE'
}
❯ app/utils/clickhouse/feedback.test.ts (8 tests | 8 failed) 75ms
× queryCommentFeedbackByTargetId 22ms
→ undefined
× countCommentFeedbackByTargetId 10ms
→ Database tensorzero does not exist.
× queryFeedbackBoundsByTargetId 6ms
→ undefined
× queryFeedbackByTargetId 8ms
→ undefined
× queryMetricsWithFeedback > returns correct feedback counts for different metric types 7ms
→ undefined
× queryMetricsWithFeedback > returns empty array for nonexistent function 7ms
→ undefined
× queryMetricsWithFeedback > returns correct metrics for both inference and episode levels 8ms
→ undefined
× queryMetricsWithFeedback > returns correct feedback counts for variant 7ms
→ undefined
stderr | app/utils/supervised_fine_tuning/openAITokenCounter.test.ts > openAITokenCounter > getTokensForTools > should count tokens for functions and messages
Warning: gpt-4 is not a current version. Using default token counts.
stderr | app/utils/supervised_fine_tuning/validation.test.ts > convertToTiktokenModel > should throw error for unsupported models
Unknown model: unsupported-model, using o200k_base
stderr | app/utils/supervised_fine_tuning/openAITokenCounter.test.ts > openAITokenCounter > getTokensForTools > should handle empty functions array
Warning: gpt-4 is not a current version. Using default token counts.
❯ app/utils/clickhouse/curation.test.ts (5 tests | 5 failed) 56ms
× countCuratedInferences for boolean metrics 21ms
→ Database tensorzero does not exist.
× countCuratedInferences for float metrics 8ms
→ Database tensorzero does not exist.
× countCuratedInferences for demonstration metrics 8ms
→ Database tensorzero does not exist.
× getCuratedInferences retrieves correct data 8ms
→ Database tensorzero does not exist.
× countFeedbacksForMetric returns correct counts 10ms
→ Database tensorzero does not exist.
✓ app/utils/supervised_fine_tuning/openAITokenCounter.test.ts (24 tests | 10 skipped) 660ms
✓ app/components/function/variant/VariantPerformance.test.ts (4 tests) 2ms
✓ app/utils/clickhouse/helpers.test.ts (7 tests) 6ms
✓ app/utils/config/models.test.ts (3 tests) 3ms
✓ app/utils/clickhouse/common.test.ts (1 test) 15ms
✓ app/utils/supervised_fine_tuning/validation.test.ts (34 tests) 2158ms
✓ convertToTiktokenModel > should handle gpt-4 and gpt-4o models 420ms
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Failed Suites 8 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
FAIL app/utils/tensorzero.test.ts [ app/utils/tensorzero.test.ts ]
Error: TENSORZERO_GATEWAY_URL environment variable is required
❯ app/utils/tensorzero.server.ts:4:9
2|
3| if (!process.env.TENSORZERO_GATEWAY_URL) {
4| throw new Error("TENSORZERO_GATEWAY_URL environment variable is required");
| ^
5| }
6|
❯ app/utils/tensorzero.test.ts:2:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[1/33]⎯
FAIL app/utils/config/index.test.ts [ app/utils/config/index.test.ts ]
FAIL app/utils/config/variant.test.ts [ app/utils/config/variant.test.ts ]
FAIL app/utils/clickhouse/datasets.test.ts [ app/utils/clickhouse/datasets.test.ts ]
FAIL app/utils/supervised_fine_tuning/fireworks.test.ts [ app/utils/supervised_fine_tuning/fireworks.test.ts ]
FAIL app/utils/supervised_fine_tuning/openai.test.ts [ app/utils/supervised_fine_tuning/openai.test.ts ]
Error: Failed to load url ../minijinja/pkg/minijinja_bindings (resolved id: ../minijinja/pkg/minijinja_bindings) in /Users/oliver/Repos/tensorzero/ui/app/utils/config/variant.ts. Does the file exist?
❯ loadAndTransform node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected][email protected]/node_modules/vite/dist/node/chunks/dep-Bid9ssRr.js:41317:17
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[2/33]⎯
FAIL app/utils/clickhouse/evaluations.test.ts [ app/utils/clickhouse/evaluations.test.ts ]
Error: Failed to load url ../minijinja/pkg/minijinja_bindings (resolved id: ../minijinja/pkg/minijinja_bindings) in /Users/oliver/Repos/tensorzero/ui/app/utils/config/variant.ts. Does the file exist?
❯ loadAndTransform node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected][email protected]/node_modules/vite/dist/node/chunks/dep-Bid9ssRr.js:41317:17
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[3/33]⎯
FAIL app/utils/clickhouse/inference.test.ts [ app/utils/clickhouse/inference.test.ts ]
Error: TENSORZERO_GATEWAY_URL environment variable is required
❯ app/utils/tensorzero.server.ts:4:9
2|
3| if (!process.env.TENSORZERO_GATEWAY_URL) {
4| throw new Error("TENSORZERO_GATEWAY_URL environment variable is required");
| ^
5| }
6|
❯ app/utils/resolve.server.ts:14:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[4/33]⎯
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Failed Tests 25 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
FAIL app/utils/clickhouse/curation.test.ts > countCuratedInferences for boolean metrics
FAIL app/utils/clickhouse/curation.test.ts > countCuratedInferences for float metrics
FAIL app/utils/clickhouse/curation.test.ts > countCuratedInferences for demonstration metrics
FAIL app/utils/clickhouse/curation.test.ts > getCuratedInferences retrieves correct data
FAIL app/utils/clickhouse/curation.test.ts > countFeedbacksForMetric returns correct counts
FAIL app/utils/clickhouse/feedback.test.ts > countCommentFeedbackByTargetId
FAIL app/utils/clickhouse/function.test.ts > getVariantPerformances > getVariantPerformances for extract_entities
FAIL app/utils/clickhouse/function.test.ts > getVariantPerformances > getVariantPerformances for write_haiku
FAIL app/utils/clickhouse/function.test.ts > getVariantPerformances > getVariantPerformances for ask_question and solved
FAIL app/utils/clickhouse/function.test.ts > getVariantPerformances > getVariantPerformances for ask_question and num_questions
FAIL app/utils/clickhouse/function.test.ts > getVariantPerformances with variant filtering > getVariantPerformances for extract_entities with specific variant
FAIL app/utils/clickhouse/function.test.ts > getVariantPerformances with variant filtering > getVariantPerformances for write_haiku with specific variant
FAIL app/utils/clickhouse/function.test.ts > getVariantPerformances with variant filtering > getVariantPerformances for ask_question and solved with specific variant
FAIL app/utils/clickhouse/function.test.ts > getVariantPerformances with variant filtering > getVariantPerformances for ask_question and num_questions with specific variant
FAIL app/utils/clickhouse/function.test.ts > getVariantPerformances with variant filtering > getVariantPerformances for non-existent metric
FAIL app/utils/clickhouse/function.test.ts > getVariantCounts > getVariantCounts for extract_entities
FAIL app/utils/clickhouse/function.test.ts > getVariantCounts > getVariantCounts for write_haiku
FAIL app/utils/clickhouse/function.test.ts > getUsedVariants > getUsedVariants for extract_entities
Error: Database tensorzero does not exist.
❯ parseError node_modules/.pnpm/@[email protected]/node_modules/packages/client-common/src/error/parse_error.ts:30:12
❯ ClientRequest.onResponse node_modules/.pnpm/@[email protected]/node_modules/packages/client-node/src/connection/node_base_connection.ts:510:30
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[5/33]⎯
FAIL app/utils/clickhouse/feedback.test.ts > queryCommentFeedbackByTargetId
{
type: 'DataWithResponseInit',
data: 'Error querying comment feedback',
init: { status: 500 },
expected: 'undefined',
actual: 'undefined',
constructor: 'Function<DataWithResponseInit>',
stacks: []
}
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[6/33]⎯
FAIL app/utils/clickhouse/feedback.test.ts > queryFeedbackBoundsByTargetId
{
type: 'DataWithResponseInit',
data: 'Error querying comment feedback bounds',
init: { status: 500 },
expected: 'undefined',
actual: 'undefined',
constructor: 'Function<DataWithResponseInit>',
stacks: []
}
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[7/33]⎯
FAIL app/utils/clickhouse/feedback.test.ts > queryFeedbackByTargetId
{
type: 'DataWithResponseInit',
data: 'Error querying boolean metrics',
init: { status: 500 },
expected: 'undefined',
actual: 'undefined',
constructor: 'Function<DataWithResponseInit>',
stacks: []
}
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[8/33]⎯
FAIL app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns correct feedback counts for different metric types
{
type: 'DataWithResponseInit',
data: 'Error fetching metrics with feedback',
init: { status: 500 },
expected: 'undefined',
actual: 'undefined',
constructor: 'Function<DataWithResponseInit>',
stacks: []
}
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[9/33]⎯
FAIL app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns empty array for nonexistent function
{
type: 'DataWithResponseInit',
data: 'Error fetching metrics with feedback',
init: { status: 500 },
expected: 'undefined',
actual: 'undefined',
constructor: 'Function<DataWithResponseInit>',
stacks: []
}
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[10/33]⎯
FAIL app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns correct metrics for both inference and episode levels
{
type: 'DataWithResponseInit',
data: 'Error fetching metrics with feedback',
init: { status: 500 },
expected: 'undefined',
actual: 'undefined',
constructor: 'Function<DataWithResponseInit>',
stacks: []
}
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[11/33]⎯
FAIL app/utils/clickhouse/feedback.test.ts > queryMetricsWithFeedback > returns correct feedback counts for variant
{
type: 'DataWithResponseInit',
data: 'Error fetching metrics with feedback',
init: { status: 500 },
expected: 'undefined',
actual: 'undefined',
constructor: 'Function<DataWithResponseInit>',
stacks: []
}
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[12/33]⎯
Test Files 11 failed | 6 passed (17)
Tests 25 failed | 63 passed | 10 skipped (98)
Start at 14:59:26
Duration 2.56s (transform 334ms, setup 0ms, collect 543ms, tests 3.10s, environment 1ms, prepare 732ms)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment