Qwen3.8-27B, with vision, holding 451K tokens of KV on a single RTX 5090, under a 400 W cap, in a container. Stock fp8 KV fits ~124K total on this card; this stack does 3.6x that, so three parallel sessions' context (3×75K) stays resident in the pool: sessions keep their KV and continue without re-prefill cost.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash -e | |
| #------------------------------------------------------------------------------------- | |
| # Summary: Executes commands to... | |
| # * Check/output currently installed version of gnupg | |
| # * Change into the brew repo/install directory | |
| # * Find the git commit-id of the specified version of gnupg | |
| # * git branch/switch to the commit-id | |
| # * replace the brew installed version with the specified version (and pin it) | |
| # * clean up the branch, switch back to master, and remove cached files | |
| # * Check/output the newly installed version of gnupg |