Skip to content

Instantly share code, notes, and snippets.

@simon-mo
Created October 13, 2022 16:41
Show Gist options
  • Select an option

  • Save simon-mo/173dfb7354eab78eb67ef01b6a7c2e93 to your computer and use it in GitHub Desktop.

Select an option

Save simon-mo/173dfb7354eab78eb67ef01b6a7c2e93 to your computer and use it in GitHub Desktop.
from ray import serve
@serve.deployment(route_prefix="/", num_replicas=20)
def f():
return "Hello"
serve.start(detached=True, http_options={"host": "0.0.0.0"})
f.deploy()
entrypoint: python app.py
runtime_env:
working_dir: .
upload_path: s3://tchordia-test-re/runtime-env
healthcheck_url: "/healthcheck"
compute_config: simon-bugbash-cpu-workers
cluster_env: simon-ray-20-37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment