single node benchmark

benchmark.txt

```
python3 -m vllm.entrypoints.openai.api_server --host "0.0.0.0" --port "8000" --model deepseek-ai/deepseek-coder-6.7b-instruct --max-model-len 32768
```

```
git clone https://github.com/vllm-project/vllm.git
```

```
python3 benchmark_serving.py --backend openai     --base-url http://127.0.0.1:8000     --dataset-name=random     --model deepseek-ai/deepseek-coder-6.7b-instruct     --seed 12345
```