Jack Rudenko erudenko

LLM Speed Benchmark: 6 Models, OpenRouter vs Direct API

A practical speed benchmark comparing 6 frontier coding LLMs on the same task, routed through claudish — an open-source proxy that lets Claude Code use any AI model.

Each model is tested via two routes: OpenRouter (proxy) and the provider's native Direct API.

What We Tested

Task: Generate a TypeScript function parseQueryParams — parse URL query parameters into Record<string, string>, handling edge cases (missing values, duplicate keys, encoded characters), with JSDoc.

LLM Speed Benchmark: 6 Models, OpenRouter vs Direct API

A practical speed benchmark comparing 6 frontier coding LLMs on the same task, routed through claudish — an open-source proxy that lets Claude Code use any AI model.

Each model is tested via two routes: OpenRouter (proxy) and the provider's native Direct API.

What We Tested

Task: Generate a TypeScript function parseQueryParams — parse URL query parameters into Record<string, string>, handling edge cases (missing values, duplicate keys, encoded characters), with JSDoc.

Golang Interview Task: Event Bus with Middleware Support

Problem Statement

Design and implement an event-driven messaging system in Go that supports middleware processing, similar to middleware patterns found in web frameworks like Express.js or Gin.

Core Requirements

Build an event bus system that allows:

Event Registration: Subscribe handlers to named events
Middleware Pipeline: Process events through middleware before reaching handlers

Golang Interview Task: Event Bus with Middleware Support

Problem Statement

Design and implement an event-driven messaging system in Go that supports middleware processing, similar to middleware patterns found in web frameworks like Express.js or Gin.

Core Requirements

Build an event bus system that allows:

Event Registration: Subscribe handlers to named events
Middleware Pipeline: Process events through middleware before reaching handlers

Task: Build a mini event system with middleware support (like Express middleware).

class EventBus {
  // Implement:
  // - on(event, handler)
  // - use(middleware) - middleware can modify event data
 // - emit(event, data)

The Broken Elevator

Scenario: You’re testing a building’s elevator system. There are 10 floors, and the elevator should stop at all floors when buttons are pressed.

Problem:

You press the buttons for floors 3, 5, and 7. The elevator stops at 3 and 7, but skips 5.
You press buttons 2, 4, and 6. It stops at 2 and 6, but skips 4.
Now you press 1, 8, and 9. It stops at 1 and 9, but skips 8.

	import android.os.Bundle
	import android.util.Log
	import androidx.appcompat.app.AppCompatActivity
	import kotlinx.coroutines.*

	class Repository {
	private var cache: MutableList<String>? = null

	fun addToCache(item: String) {
	cache!!.add(item)

	using System;
	using System.Collections.Generic;
	using System.Linq;
	using System.Threading.Tasks;

	namespace InterviewTest
	{
	public class OrderService
	{
	private static List<Order> _orders = new List<Order>();

	import { useEffect, useState } from 'react';

	interface Props {
	query: string;
	title: string;
	}

	export const BadComponent = ({ query, title }: Props) => {
	const [results, setResults] = useState<string[]>([]);
	const [capitalised, setCapitalised] = useState('');

	import { useState } from 'react';

	export const WeatherWidget = ({ city }: { city: string }) => {
	const [temp, setTemp] = useState<number \| null>(null);

	fetch(`/api/weather?city=${city}`)
	.then(r => r.json())
	.then(data => setTemp(data.temp));

	if (temp === null) return <p>Loading…</p>;