Skip to content

Instantly share code, notes, and snippets.

@mathjazz

mathjazz/gist:41ce13a473ae939181b902b106323bd4

Created September 9, 2026 07:38
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save mathjazz/41ce13a473ae939181b902b106323bd4 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save mathjazz/41ce13a473ae939181b902b106323bd4 to your computer and use it in GitHub Desktop.
Download ZIP
LLM pilot funnel 2026-08-26 → 2026-09-09
Raw
gistfile1.txt
LLM pilot funnel 2026-08-26 → 2026-09-09
locales: ar, cs, de, el, es-AR, es-CL, es-ES, es-MX, fi, fr, hu, id, it, ja, nl, pl, pt-BR, pt-PT, ro, ru, sk, sv-SE, sl, tr, vi, zh-CN, zh-TW
locale shown cache p50 p95 in k out k USD | copied copy% saved save% appr rej pend appr% users
-------------------------------------------------------------------------------------------------------------------------------
ar 60 31.7% 1417 2686 14.2 0.6 0.07 | 5 8.3% 1 20.0% 0 0 1 0.0% 1
cs 183 4.9% 1386 2566 57.3 2.5 0.28 | 30 16.4% 17 56.7% 17 0 0 100.0% 1
de 968 17.0% 1626 4291 377.1 12.0 1.75 | 71 7.3% 46 64.8% 40 6 0 87.0% 3
el 499 16.6% 1987 5406 150.5 15.0 0.90 | 22 4.4% 5 22.7% 5 0 0 100.0% 1
es-AR 264 15.9% 1284 2409 77.1 3.6 0.38 | 29 11.0% 21 72.4% 21 0 0 100.0% 1
es-CL 110 3.6% 1332 2478 37.4 1.3 0.17 | 13 11.8% 9 69.2% 8 1 0 88.9% 1
es-ES 491 2.6% 1151 1804 162.7 6.4 0.78 | 13 2.6% 3 23.1% 3 0 0 100.0% 1
es-MX 102 13.7% 1607 3202 43.8 2.1 0.22 | 2 2.0% 0 0.0% 0 0 0 - 0
fi 253 9.9% 1484 3153 73.3 3.6 0.36 | 26 10.3% 16 61.5% 14 2 0 87.5% 1
fr 579 20.9% 1689 3542 231.9 9.3 1.11 | 14 2.4% 7 50.0% 7 0 0 100.0% 1
hu 406 14.8% 1422 3477 114.1 6.6 0.59 | 32 7.9% 27 84.4% 18 3 6 66.7% 2
id 804 10.9% 1285 4938 235.8 8.7 1.12 | 81 10.1% 52 64.2% 52 0 0 100.0% 1
it 489 30.7% 1581 3646 163.5 8.8 0.83 | 35 7.2% 18 51.4% 18 0 0 100.0% 1
ja 141 17.0% 1350 2398 36.5 1.5 0.18 | 8 5.7% 1 12.5% 1 0 0 100.0% 1
nl 251 10.4% 1302 2845 72.2 2.3 0.33 | 4 1.6% 3 75.0% 3 0 0 100.0% 1
pl 647 22.7% 1341 3070 161.1 9.8 0.84 | 80 12.4% 22 27.5% 19 3 0 86.4% 2
pt-BR 301 34.6% 1241 2399 67.1 2.3 0.31 | 27 9.0% 4 14.8% 4 0 0 100.0% 1
pt-PT 3014 2.7% 1297 2583 968.5 43.5 4.74 | 103 3.4% 41 39.8% 39 2 0 95.1% 2
ro 271 13.3% 1315 2548 76.6 3.1 0.37 | 31 11.4% 18 58.1% 8 0 10 44.4% 2
ru 185 4.9% 1409 2835 57.4 2.2 0.27 | 45 24.3% 27 60.0% 27 0 0 100.0% 1
sk 171 2.3% 1390 2661 55.7 2.6 0.28 | 76 44.4% 63 82.9% 62 1 0 98.4% 1
sl 1010 14.2% 1477 3245 444.5 18.5 2.15 | 24 2.4% 6 25.0% 4 0 2 66.7% 1
sv-SE 206 10.7% 1364 2728 60.4 2.5 0.29 | 22 10.7% 13 59.1% 13 0 0 100.0% 1
tr 2353 36.5% 1361 3351 705.3 28.1 3.38 | 102 4.3% 32 31.4% 26 4 2 81.2% 2
vi 110 17.3% 1105 1618 27.3 1.0 0.13 | 1 0.9% 0 0.0% 0 0 0 - 0
zh-CN 1367 23.5% 1257 2547 354.6 13.5 1.69 | 94 6.9% 56 59.6% 6 12 38 10.7% 2
zh-TW 170 6.5% 1310 2677 56.0 2.2 0.27 | 14 8.2% 5 35.7% 5 0 0 100.0% 1
-------------------------------------------------------------------------------------------------------------------------------
total 15405 16.9% 1105 5406 4881.9 213.4 23.79 | 1004 6.5% 513 51.1% 420 34 59 81.9% 33
cache/p50/p95/in k/out k from llm_suggestion log lines; percentiles cover cache misses only and span locales on the total row
AI dropdown (manual trigger, all locales)
requested 201 cache 11.9%, p50 2063 ms, p95 5564 ms, 68.7k in / 5.3k out, 0.38 USD
LLM Dropdown Select 136
LLM Translation Copied 67
LLM Translation Copied via Shortcut 0
copied in: fa 54, uk 6, pt-BR 2, pt-PT 2, ro 1, fr 1, es-ES 1
Baseline: saves by Machinery source
source saved approved appr%
openai-chatgpt 513 420 81.9%
google-translate 1379 1231 89.3%
translation-memory 1502 1390 92.5%
Baseline: copies by Machinery source
google-translate 2033
openai-chatgpt 1004
translation-memory 772
concordance-search 8
@flodolo

flodolo commented Sep 9, 2026

Copy link
Copy Markdown

Data from local instance

LLM pilot funnel  2026-08-13 → 2026-08-26
locales: it

locale     shown   cache    p50    p95    in k   out k     USD |  copied   copy%  saved   save%  appr  rej  pend   appr%  users
-------------------------------------------------------------------------------------------------------------------------------
it            90   16.7%   1382   2865    40.6     0.8    0.18 |      43   47.8%     28   65.1%    26    2     0   92.9%      1
-------------------------------------------------------------------------------------------------------------------------------
total         90   16.7%   1382   2865    40.6     0.8    0.18 |      43   47.8%     28   65.1%    26    2     0   92.9%      1

cache/p50/p95/in k/out k from llm_suggestion log lines; percentiles cover cache misses only and span locales on the total row

AI dropdown (manual trigger, all locales)
  requested                                     6   cache 0.0%, p50 2367 ms, p95 3089 ms, 3.7k in / 0.1k out, 0.02 USD
  LLM Dropdown Select                           6
  LLM Translation Copied                        3
  LLM Translation Copied via Shortcut           0
  copied in: it 3

Baseline: saves by Machinery source
  source                      saved  approved   appr%
  openai-chatgpt                 28        26   92.9%
  google-translate               31        26   83.9%
  translation-memory             44        43   97.7%

Baseline: copies by Machinery source
  google-translate               50
  openai-chatgpt                 43
  translation-memory             13

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment