Derek Colley dcolley

Verifiable AI Inference: Proving the Model You Paid For

Summary

Survey of verifiable AI inference as of May 2026. API contracts typically do not bind the model billed to the weights executed; the sections below survey mechanisms that address it.

zkML (ZK proofs): Cryptographic binding, no honest-party assumption. Systems include zkLLM, NANOZK, TensorCommitments, EZKL, DeepProve, zkPyTorch/Expander, JSTprove. zkLLM: ~15 min proving for 13B (2024); NANOZK: 24 ms layer verification, ~70× smaller proofs than EZKL at depth 128 (2026).
TEEs: Remote attestation rooted in hardware (Anthropic/Irregular whitepaper, June 2025). NVIDIA H100/Blackwell GPU-CC is the practical deployment path; Tinfoil Modelwrap binds weight commitments to enclave measurement.
opML: Optimistic fraud proofs (ORA); bisection dispute games from rollup designs. Low cost at scale; ~7-day dispute window excludes interactive latency targets.
SVIP: Statistical checks on hidden activations; sub-10 ms overhead, <5% error in reported ev

venv

uv venv my_venv
source my_venv/bin/activate
uv pip install -r requirements.txt

requirements.txt

JAM CLI Tool (jamt) Features

The JAM CLI tool (jamt) is a command-line interface for interacting with the JAM blockchain. Here's a comprehensive overview of its features and commands.

Global Options

--rpc <RPC>: Specify the RPC connection URL (default: ws://localhost:19800)
--bootstrap-service-id <BOOTSTRAP_SERVICE_ID>: Set the Bootstrap service ID (default: 0)
--provision <PROVISION>: Strategy for providing data to services (default: bootstrap)
Possible values: none, direct, bootstrap

Release Management

Goals

We need to release our tools and libraries in a way that is easy to use and contribute.

github.com for issues and pull requests
git for version control
Git branching model
Git Release management[?]

	#!/usr/bin/env bash
	# dgx-monitor.sh — DGX Spark cluster watcher
	# Usage: ./dgxmon spark1 spark2 localhost spark3 ...

	set -euo pipefail

	HOSTS=("$@")
	SESSION="dgx-monitor"
	REFRESH_MS=2000
	USER="${DGX_USER:-$(whoami)}"

	const { spawn } = require('child_process');
	const split2 = require('split2');
	const moment = require('moment');

	const TIMEOUT = 300 * 1000; // nn seconds, in milliseconds
	const ECHOLOG = false;
	// DEBUG: minumum is 'info', we need info to see log messages!
	const DEBUG = '-linfo'
	// const DEBUG = '-lsync=debug,gossip=debug,peerset=debug,sub-libp2p=info' // '-ldebug'
	// const DEBUG = '-ldebug' // VERY verbose, kills the terminal

	/*
	Checks if an address has votes, and removes them if needed
	Edit the NODE_WS_URL as needed
	*/

	import { Keyring, ApiPromise, WsProvider } from '@polkadot/api'
	import readline from 'readline';

	const NODE_WS_URL = 'wss://rpc.ibp.network/kusama'
	// const NODE_WS_URL = 'wss://rpc.ibp.network/polkadot'

	{
	"name": "metaspan",
	"description": "metaspan Cardano Stake Pool",
	"ticker": "MSPN",
	"homepage": "https://metaspan.com"
	}