The GFX1250→GFX942 cross-family ISA transpiler passes 18-19/20 tests. The remaining failure is the matmul_splitk test, where the inner loop exits prematurely and non-deterministically. This document details the exhaustive investigation.
The split-K matmul uses two kernels:
matmul_splitk_compute (236 GFX12 instructions): Each workgroup computes a partial matmul for a chunk of K. Uses blockIdx.y for split index.
| Launch docker: | |
| rocm/sgl-dev:v0.5.8.post1-rocm720-mi30x-20260211-preview | |
| Inside container - | |
| Install Sglang from source by following - | |
| https://docs.sglang.io/platforms/amd_gpu.html#install-from-source | |
| Install transformer from source - |
| hipblaslt-bench --api_method c -m 768 -n 77 -k 768 --lda 768 --ldb 768 --ldc 768 --ldd 768 --stride_a 0 --stride_b 0 --stride_c 0 --stride_d 0 --alpha 1.000000 --beta 0.000000 --transA T --transB N --batch_count 1 --scaleA 0 --scaleB 0 --bias_vector --bias_source d --a_type f32_r --b_type f32_r --c_type f32_r --d_type f32_r --scale_type f32_r --bias_type f32_r --compute_type f32_r --algo_method index --solution_index 1270 --activation_type none --any_stride --rotating 0 --cold_iters 0 --iters 0 |
| # Stick this in C:\Users\<login>\OneDrive\Documents\PowerShell\ | |
| # Test-Path -Path $PROFILE | |
| # New-Item -ItemType File -Path $PROFILE -Force | |
| # code $PROFILE | |
| $vswhere = "${env:ProgramFiles(x86)}\Microsoft Visual Studio\Installer\vswhere.exe" | |
| # Check if vswhere exists, if not you may need to adjust the path or install the VS installer | |
| if (-not (Test-Path $vswhere)) { | |
| Write-Host "vswhere.exe not found at the expected location." | |
| # Provide a link to the official vswhere documentation if needed | |
| } |
| # Training data consist of X=(str, str), y=float: | |
| from sklearn.model_selection import train_test_split | |
| X = [ | |
| ["Hello World!", "Good morning!"], | |
| ["It is raining", "It is cold"], | |
| ["Beautiful city beside mountain", "Quiet street in downtown area"], | |
| ["AI is the future", "AI is just a tool"], | |
| ["This application is great", "software is the problem"], | |
| ["Hello World!", "Good morning!"], | |
| ["It is raining", "It is cold"], |
Visualization of the MobileNet-v3-large shapes (ordered similarly by decreasing time percentage, so the most important shapes come first).
