Chao Shi stepinto
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Baseline: DS TP8 L3 | |
| sglang serve \ | |
| --model=deepseek-ai/DeepSeek-V4-Flash \ | |
| --tp-size 8 \ | |
| --moe-runner-backend flashinfer_mxfp4 \ | |
| --disable-cuda-graph \ | |
| --mem-fraction-static 0.85 \ | |
| --reasoning-parser deepseek-v4 \ | |
| --tool-call-parser deepseekv4 \ | |
| --host 0.0.0.0 \ |
stepinto
/ gist:cd23803e21da1d0100e8b3941308ca8f
Created
September 17, 2025 11:31
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| eth0 ---- sw1a --- sw2a --- sw3a --- eth0 | |
| host1 X X host2 | |
| eth1 ---- sw1b --- sw2b --- sw3b --- eth1 |
stepinto
/ gist:8060860b1569e1d5d232db7cf3d2e29c
Created
September 17, 2025 11:29
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| eth0 ---- sw1a --- sw2a --- sw3a --- eth0 | |
| host1 X X host2 | |
| eth1 ---- sw1b --- sw2b --- eth1 --- eth1 |