Skip to content

Instantly share code, notes, and snippets.

@baughmann

baughmann/vllm-phi3-ray-bug.ipynb

Created July 20, 2024 14:46
Show Gist options
  • Save baughmann/f4bcdbdef07e05b587aa04ccc7f0cf7c to your computer and use it in GitHub Desktop.
Save baughmann/f4bcdbdef07e05b587aa04ccc7f0cf7c to your computer and use it in GitHub Desktop.
Download ZIP
vLLM Ray Phi-3 bug
Display the source blob
Display the rendered blob
Raw
vllm-phi3-ray-bug.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment