Santiago Valdarrama svpino

🏠

Working from home

I care a whole lot about building software. More specifically, I lose sleep over Machine Learning and Computer Vision.

svpino / commands.txt

Created February 24, 2025 20:14

Running DeepSeek on HPC

	# Loading and serving the model:

	vllm serve /root/commonData/DeepSeek-R1 \
	--host 0.0.0.0 \
	--port 8000 \
	--enable-reasoning \
	--reasoning-parser deepseek_r1 \
	--tensor-parallel-size 8 \
	--load-format auto \
	--trust-remote-code \