Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save vanbasten23/d5be988a5c831ccce0209a9f9703f822 to your computer and use it in GitHub Desktop.
Save vanbasten23/d5be988a5c831ccce0209a9f9703f822 to your computer and use it in GitHub Desktop.
{
// Use IntelliSense to learn about possible attributes.
// Hover to view descriptions of existing attributes.
// For more information, visit: https://go.microsoft.com/fwlink/?linkid=830387
"version": "0.2.0",
"configurations": [
{
"name": "vllm",
"type": "debugpy",
"request": "launch",
"program": "/home/xiowei/miniconda3/envs/vllm/bin/pytest",
"console": "integratedTerminal",
"env": {
"VLLM_USE_V1": "1",
},
"args": [
"-s",
"-vv",
"/mnt/disks/persist/vllm/tests/v1/tpu/test_sampler.py",
"-k",
"test_logprobs",
// "/mnt/disks/persist/vllm/tests/v1/entrypoints/llm/test_struct_output_generate.py",
// "-k",
// "test_structured_output_auto_mode",
// "--port",
// "8003",
// "--gpu-memory-utilization",
// "0.98",
// "--max-num-batched-tokens",
// "8192",
// "--num-scheduler-steps",
// "8",
// "--tensor-parallel-size",
// "1",
// "--max-model-len",
// "2048"
]
},
]
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment