Skip to content

Instantly share code, notes, and snippets.

View therealkenc's full-sized avatar

therealkenc

64 followers · 2 following
View GitHub Profile
@therealkenc
therealkenc / pr-21174+codex.patch
Created May 3, 2026 01:41
Snapshot before the first parse
diff --git a/tools/server/server-context.cpp b/tools/server/server-context.cpp
index d4f10e59f..c82d0b77c 100644
--- a/tools/server/server-context.cpp
+++ b/tools/server/server-context.cpp
@@ -3893,14 +3893,27 @@ void server_routes::init_routes() {
}
}
SRV_DBG("converted request: %s\n", debug_body.dump().c_str());
+ // Pre-build the parser variant before the first parse:
+ // oaicompat_chat_params_parse mutates `body` content parts in
@therealkenc
therealkenc / pr-21174-multimodal-tool.patch
Created May 2, 2026 22:03
patch against ggml-org/llama.cpp#21174 to add multimodal tool call responses
diff --git a/tools/server/server-chat.cpp b/tools/server/server-chat.cpp
index 8ef7766fd..1626f70db 100644
--- a/tools/server/server-chat.cpp
+++ b/tools/server/server-chat.cpp
@@ -31,7 +31,7 @@ json server_chat_convert_responses_to_chatcmpl(const json & response_body) {
throw std::invalid_argument("llama.cpp does not support 'previous_response_id'.");
}
- const json input_value = response_body.at("input");
+ const json & input_value = response_body.at("input");
@therealkenc
therealkenc / gist:617b4a9c29e123734fadcc9c079b5777
Created July 3, 2025 20:26
gemini hello url context
The secret word is "Apple"
@therealkenc
therealkenc / gist:b19ad90285eb38eb596ec4869941abb2
Last active January 1, 2025 08:29
> openai@4.77.1 debug:tools
> ts-node -r tsconfig-paths/register examples/tool-call-helpers.ts
Starting main function...
(node:219045) [DEP0040] DeprecationWarning: The `punycode` module is deprecated. Please use a userland alternative instead.
(Use `node --trace-deprecation ...` to show where the warning was created)
OUTGOING REQUEST: POST https://generativelanguage.googleapis.com/v1beta/openai/chat/completions
Request body: {
@therealkenc
therealkenc / gist:c2fff3f463c241f698b262c9c959cb67
Last active January 1, 2025 08:28
Google OAI compatibility endpoint test
#!/usr/bin/env -S npm run tsn -T
import fetch from 'node-fetch';
import { RequestInit, Response, RequestInfo } from 'node-fetch';
import 'openai/shims/web'; // <--- Wait, wut? Why "shims/web"??? Why not "shims/node"???
import OpenAI from 'openai';
import { RunnableToolFunction } from 'openai/lib/RunnableFunction';
const config = {
gemini: {
@therealkenc
therealkenc / fetch.py
Last active May 27, 2024 05:40
tv fetch events
import http.client
import json
import gzip
import io
import pandas as pd
from urllib.parse import urlencode
# Headers found experimentally to work from a web traffic trace
headers = {
"Accept": "application/json",
@therealkenc
therealkenc / gist:46afe6f09da9edde4b55c8ccbf550bf0
Last active May 25, 2024 21:38
scrape https://www.forexfactory.com/calendar
import sys
import http.client
import gzip
import io
import pandas as pd
from bs4 import BeautifulSoup
# Define the URL and headers
url = 'www.forexfactory.com'
if len(sys.argv) > 1:
@therealkenc
therealkenc / gist:7073c4a2e9cac380e079708c4ed1721c
Created September 23, 2023 07:32
jni-bind build with typedef long jint
In file included from src/main/c/com_coralblocks_javatocppandback_jni_bind_HelloWorld.cpp:1:
src/main/c/jni_bind_release.h:7749:15: warning: implicit capture of 'this' with a capture default of '=' is deprecated [-Wdeprecated-this-capture]
7749 | (*this)("loadClass", IdClassT::kNameUsingDots);
| ^
src/main/c/jni_bind_release.h:7745:56: note: add an explicit capture of 'this' to capture '*this' by reference
7745 | 0>>::PrimeJClassFromClassLoader([=]() {
| ^
| , this
src/main/c/jni_bind_release.h:507:19: error: static assertion failed due to requirement 'AllUnique_v<void, unsigned char, bool, signed char, short, long, float, long, long long, char, unsigned short, double, std::string, _jstring *, char *, const char *, std::string_view, jni::RefBaseTag<_jstring *>, _jobject *, jni::RefBaseTag<_jobject *>, jni::LoaderTag, jni::Object, jni
@therealkenc
therealkenc / gist:aa3d94a6e4b3f8e6d2b9da8449768d71
Created June 23, 2021 20:17
wsl7074
[ 0.000000] Linux version 5.10.16.3-microsoft-standard-WSL2 (oe-user@oe-host) (x86_64-msft-linux-gcc (GCC) 9.3.0, GNU ld (GNU Binutils) 2.34.0.20200220) #1 SMP Fri Apr 2 22:23:49 UTC 2021
[ 0.000000] Command line: initrd=\initrd.img panic=-1 nr_cpus=32 swiotlb=force console=ttyS0,115200 debug pty.legacy_count=0 memmap=4G!64M
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
@therealkenc
therealkenc / wsl-6765-on-21370.dmesg
Last active April 29, 2021 21:58
[ 0.000000] Linux version 5.10.16.3-microsoft-standard-WSL2 (oe-user@oe-host) (x86_64-msft-linux-gcc (GCC) 9.3.0, GNU ld (GNU Binutils) 2.34.0.20200220) #1 SMP Fri Apr 2 22:23:49 UTC 2021
[ 0.000000] Command line: initrd=\initrd.img panic=-1 nr_cpus=32 swiotlb=force pty.legacy_count=0
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256