Dak Washbrook dakdevs

QA Comparison: Main vs Skills Architecture

Side-by-side comparison of the native tool architecture (main) vs the skill+bash architecture across 85+ QA scenarios. Both runs use the same Qwen 3.5 397B model on the same hardware, same NATS infrastructure, same QA evaluator. Only the os-assistant binary and scenario acceptance criteria differ.

Skills scored 48 GREAT vs main's 44 with the same BAD count (23 vs 23). Token usage was comparable (10.3M vs 10.3M) with fewer LLM calls (4,869 vs 5,649). Median time to first audio was 1.5s (skills) vs 1.7s (main).

Grade Summary

	Main	Skills

OS Assistant: Skill+Bash Architecture vs Native Tools — Full Comparison

Date: 2026-04-03 Branch under test: autoresearch/apr03 (skill+bash) vs main (native tools) Eval harness: os-qa automated scenario runner (84 scenarios)

	#!/usr/bin/env bash
	# Setup an Ubuntu machine to be SSH-able from dakdevs' Mac.
	# Idempotent: safe to re-run.
	#
	# Usage (on the Ubuntu machine):
	# curl -fsSL <gist-raw-url> \| bash

	set -euo pipefail

	PUBKEY="ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEqJZkbO069wsfHTuRDMPLNe8SWozP5Gf/cpTgxT3XI1 dakdevs-mac"

	#!/usr/bin/env bash
	# install-xrdp.sh — set up remote desktop (xrdp + Xfce) on a remote Ubuntu box
	#
	# Run this on your Mac. It will:
	# 1. Check for / install the Mac RDP client (Windows App) via Homebrew or App Store
	# 2. Prompt for the SSH host and Linux user to configure
	# 3. scp itself over, run via sudo, clean up after
	# 4. Install xrdp + xorgxrdp + xfce4 on the remote
	# 5. Configure ~/.xsession to launch Xfce with an isolated dbus bus
	# (so it coexists with any GNOME session on the physical monitor)

	{
	"$schema": "https://opencode.ai/theme.json",
	"defs": {
	"purple-600": "#5266eb",
	"purple-700": "#465bd1",
	"purple-800": "#3442a6",
	"purple-400": "#8da4f5",
	"purple-300": "#a7b6f8",
	"red-600": "#d03275",
	"red-700": "#b0175f",

	#!/bin/bash

	# Run by calling the following from the terminal:
	# curl -sL https://fromdak.to/setup \| bash

	mac_os_settings() {
	echo "Turning off mouse cursor acceleration..."
	defaults write -g com.apple.mouse.scaling -1
	}

	const boldText = "The React Framework for the Web.";
	const regularText =
	"Used by some of the world's largest companies, Next.js enables you to create high-quality web applications with the power of React components.";

	// Use in img src
	const nextjsConfHero = "/nextjs-conf-hero.svg";
	const nextjsConfLogo = "/nextjs-conf-logo.svg";
	const nextjsLogo = "/nextjs-logo.svg";

	export default function Page() {

	<table style="border-collapse: collapse;">
	<thead>
	<tr style="border-bottom: 1px solid rgb(56, 68, 77);">
	<th
	style="width: 36%; text-align: start; padding: 8px; position: sticky; top: 0px; background-color: rgb(30, 39, 50); z-index: 1;">
	<div dir="ltr" class="css-146c3p1 r-bcqeeo r-1ttztb7 r-qvutc0 r-37j5jr r-a023e6 r-rjixqe r-b88u0q"
	style="text-overflow: unset; color: rgb(247, 249, 249);"><span
	class="css-1jxf684 r-bcqeeo r-1ttztb7 r-qvutc0 r-poiln3" style="text-overflow: unset;">Post</span></div>
	</th>

	import React from 'react'
	import ReactDOM from 'react-dom'
	import { Modal } from 'antd'

	const useModal = (Component, props) => {
	const [open, setOpen] = React.useState(false)
	const [loading, setLoading] = React.useState(false)

	const onOk = props.onOk \|\| (() => {})
	const handleOk = () => {

Dak Washbrook dakdevs

QA Comparison: Main vs Skills Architecture

Grade Summary

OS Assistant: Skill+Bash Architecture vs Native Tools — Full Comparison

Table of Contents