Skip to content

Instantly share code, notes, and snippets.

@taf2
taf2 / deepswe-glm52-test-full.md
Created July 3, 2026 19:25
DeepSWE full benchmark: GLM-5.2 on CTM GPU box

DeepSWE Full Benchmark Result: GLM-5.2 on CTM GPU Box

Summary

GLM-5.2 completed the full Datacurve DeepSWE benchmark with 23 full solves out of 113 tasks.

  • Benchmark: DeepSWE full run, 113 tasks
  • Agent harness: Pier + mini-swe-agent
  • Model endpoint: OpenAI-compatible https://rig.ctmdev.us/v1, served model GLM-5.2
  • Job: deepswe-glm52-test-full
@taf2
taf2 / deepswe-gemma4-256k-full-20260701-223016.clean.20260701-223016.console.log
Last active July 2, 2026 13:04
DeepSWE: nvidia/Gemma-4-31B-IT-NVFP4 256k vLLM run
[deepswe] mode=clean
[deepswe] job=deepswe-gemma4-256k-full-20260701-223016
[deepswe] endpoint=https://rig.ctmdev.us/small/v1
[deepswe] model=gemma4
[deepswe] pier=/home/taf2/.cache/uv/archive-v0/D78r41aCVcQ7gSm6/bin/pier
[deepswe] started=2026-07-01T22:30:17-04:00
Checking https://rig.ctmdev.us/small/v1/models ...
Running Pier job deepswe-gemma4-256k-full-20260701-223016
DeepSWE: 3cda408
Endpoint: https://rig.ctmdev.us/small/v1
@taf2
taf2 / qwen36-deepswe-summary.md
Created July 2, 2026 01:29
Qwen3.6-27B NVFP4 DeepSWE benchmark result

Qwen3.6-27B NVFP4 DeepSWE Result

  • Job: deepswe-qwen36-test-4
  • Model: qwen36
  • Endpoint: https://rig.ctmdev.us/small/v1
  • Completed: 113 / 113
  • Scored trials: 112
  • Errors: 1
  • Solved: 2 / 112
  • Reward: 0.0177
[model_providers.qwen]
name = "qwen"
base_url = "http://.../v1"
wire_api = "responses"
bearer_token_env_var = "EMPTY"
[profiles.qwen]
model_provider = "qwen"
model = "Qwen/Qwen3.6-27B"
model_reasoning_effort = "high"
public class CTMApexTextMessage {
// Your api keys from account settings
private static String apiKey() { return 'your-api-key'; }
private static String apiSec() { return 'your-api-sec'; }
private static String apiHost() { return 'api.calltrackingmetrics.com'; }
private static String apiAccount() { return 'your-account-id'; }
private static String apiAuthorization() {
return 'Basic ' + EncodingUtil.base64Encode(Blob.valueOf(apiKey() + ':' + apiSec()));
}
@taf2
taf2 / possible_now_dnc_checking.js
Created November 1, 2024 13:26
Using the PossibleNow API to filter who can be dialed or not based on Flags
// https://staging.dncsolution.com/Rest/Help
exports.handler = async (event, context) => {
const apihashkey = process.env['apihashkey'];
const clientid = process.env['clientid'];
const userid = process.env['userid'];
const profileid = process.env['profileid'];
const call = event.activity; // call, text, chat, form, video, fax, etc...
const url = `https://staging.dncsolution.com/Rest/${clientid}/Quickcheck/${userid}/${profileid}/${call.caller_number_bare}`;
// const url = `https://staging.dncsolution.com/Rest/${clientid}/Quickcheck/${userid}/${profileid}/3057604895`;
<!DOCTYPE html>
<html>
<head>
<title>Home Page</title>
<script src="https://<%= ctm_host %>/ctm-phone-embed-1.0.js"></script>
</head>
<body>
<h1>Your Application</h1>
<p>Embedding the CTM Phone</p>
<ctm-phone-embed access="/api/ctm_access" popout="/device"></ctm-phone-embed>
#!/usr/bin/osascript
function run(input, parameters) {
const appNames = [];
const skipAppNames = [];
const verbose = true;
const scriptName = "close_notifications_applescript";
public class CTMTextMessage {
// Your api keys from account settings
private static String apiKey() { return 'your-key'; }
private static String apiSec() { return 'your-sec'; }
private static String apiHost() { return 'api.calltrackingmetrics.com'; }
private static String apiAccount() { return 'your-account-id'; }
private static String apiAuthorization() {
return 'Basic ' + EncodingUtil.base64Encode(Blob.valueOf(apiKey() + ':' + apiSec()));
}