Skip to content

Instantly share code, notes, and snippets.

@mathjazz
Created August 25, 2026 20:07
Show Gist options
  • Select an option

  • Save mathjazz/3c2907c1d205e6fac91a698f75faa3a4 to your computer and use it in GitHub Desktop.

Select an option

Save mathjazz/3c2907c1d205e6fac91a698f75faa3a4 to your computer and use it in GitHub Desktop.
LLM pilot funnel 2026-08-13 → 2026-08-26
locales: de, es-MX, fr, it, sl, tr
locale shown cache p50 p95 in k out k | copied copy% saved save% appr rej pend appr% users
-----------------------------------------------------------------------------------------------------------------------
de 510 12.2% 1786 4691 248.8 7.6 | 86 16.9% 66 76.7% 63 3 0 95.5% 3
es-MX 57 10.5% 1517 3305 29.1 1.0 | 0 0.0% 0 - 0 0 0 - 0
fr 389 18.5% 1717 3619 184.9 6.7 | 38 9.8% 20 52.6% 19 1 0 95.0% 1
it 263 35.7% 1855 3883 104.7 6.0 | 40 15.2% 17 42.5% 17 0 0 100.0% 1
sl 678 15.9% 1485 3502 332.4 13.8 | 56 8.3% 14 25.0% 13 1 0 92.9% 2
tr 1313 32.7% 1401 3164 501.3 16.4 | 119 9.1% 37 31.1% 28 9 0 75.7% 2
-----------------------------------------------------------------------------------------------------------------------
total 3210 24.0% 1401 4691 1401.2 51.5 | 339 10.6% 154 45.4% 140 14 0 90.9% 9
cache/p50/p95/in k/out k from llm_suggestion log lines; percentiles cover cache misses only and span locales on the total row
AI dropdown (manual trigger, all locales)
copied in: zh-TW 17, pt-BR 8, fr 5, ur 5
Baseline: saves by Machinery source
source saved approved appr%
openai-chatgpt 154 140 90.9%
google-translate 288 247 85.8%
translation-memory 397 372 93.7%
Baseline: copies by Machinery source
google-translate 407
openai-chatgpt 339
translation-memory 264
concordance-search 4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment