sam boyer sdboyer

Test Selection Strategy for Configuration-Sensitive Tests

The Problem

The API surface test suite contains tests that exercise behaviors which may or may not be available on a given instance, depending on how that instance is configured. For example:

Model tests require models to be deployed
Inference tests require both chat and completion models, plus working inference infrastructure
Remote session tests require remote_sandbox execution environments and Temporal
Sandbox tests require at least one execution environment of any type

Install Log - Slot 6

Cluster Provisioning

Date: 2026-01-31
Slot: 6 (previously used slot 7)
Profile: AWS_PROFILE=sandbox
Command: AWS_PROFILE=sandbox ./cluster.sh apply 6 --gpu -auto-approve
Reason for rebuild: Previous slot-7 cluster had TLS/certificate issues after installation; decided to tear down and start fresh.
Previous session PRs merged: PR #56 (tpl + awsCredentialsSecretName), PR #57 (slice handling + inference SA + path-style S3)
Slot 7 teardown: Completed. Required manual cleanup of 3 orphaned K8s security groups blocking VPC deletion.

Helm Render Pipeline: Framework Assessment

Assessment of the render pipeline's capabilities relative to the tf-proto reference charts. Produced after porting the sandbox component and fixing several rendering gaps.

	<!DOCTYPE html>
	<html lang="en">
	<head>
	<meta charset="utf-8">
	<meta name="viewport" content="width=device-width, initial-scale=1">
	<title>Poolio Txtar Diff Report</title>
	<style>
	* { box-sizing: border-box; margin: 0; padding: 0; }
	body { font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, monospace; background: #f5f5f5; color: #333; }

	{
	"name": "Dashboard",
	"maturity": "experimental",
	"description": "A Grafana dashboard.",
	"lineage": {
	"schemas": [
	{
	"version": [
	0,
	0

	import "github.com/grafana/thema"

	thema.#Lineage
	name: "trivial-two"
	schemas: [{
	version: [0, 0]
	schema: {
	firstfield: string
	}
	},

	// Copyright 2023 Grafana Labs
	//
	// Licensed under the Apache License, Version 2.0 (the "License");
	// you may not use this file except in compliance with the License.
	// You may obtain a copy of the License at
	//
	// http://www.apache.org/licenses/LICENSE-2.0
	//
	// Unless required by applicable law or agreed to in writing, software
	// distributed under the License is distributed on an "AS IS" BASIS,

	// Copyright 2023 Grafana Labs
	//
	// Licensed under the Apache License, Version 2.0 (the "License");
	// you may not use this file except in compliance with the License.
	// You may obtain a copy of the License at
	//
	// http://www.apache.org/licenses/LICENSE-2.0
	//
	// Unless required by applicable law or agreed to in writing, software
	// distributed under the License is distributed on an "AS IS" BASIS,