| ID | Python Version | PyTorch Version | Inference Mode | GPU Support Status | Avg. Time per Image | GPU Utilization | Notes |
|---|---|---|---|---|---|---|---|
| ① | 3.9.13 | 2.4.1 | Vulkan fallback | ❌ Not supported (sm_120) | ~2.12 sec | Low (occasional spikes) | Auto fallback to Vulkan/NCNN |
| ② | 3.13.7 | 2.9.0 Nightly | Vulkan fallback | ✅ Supported (sm_120, CUDA off) | ~1.94 sec | Medium-low | Forced with --nocuda |
| ③ | 3.13.7 | 2.9.0 Nightly | CUDA | ✅ Supported (sm_120, enabled) | ~1.04 sec | High (stable 100%) | Full CUDA inference enabled |
Last active
August 31, 2025 17:29
-
-
Save allenk/b45e928865c7525f979a571b1f6d2f2c to your computer and use it in GitHub Desktop.
Blackwell, PyTorch CUDA Support
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment