| Component | Purpose |
|---|---|
| Fargate | Serveless compute for LiteLLM |
| Aplication Load Balancer (internal) | Route traffic to LiteLLM, perform health checks |
| Aurora PostgreSQL | Serverless database for LiteLLM config, API keys, and usage metrics |
| Bedrock | Provide access to foundation models |
| S3 Bucket | Capture LiteLLM logs for monitoring and troubleshooting |
| Private VPC Subnets | Isolate your LiteLLM stack from direct internet exposure |
| Client VPN Endpoint | Provide secure, certificate-based access to LiteLLM in private subnet |
| OpenVPN Connect | Client to connect to VPN Endpoint |
| GenAI App Client | We will use Cline as example |
Last active
April 11, 2025 23:43
-
-
Save sofianhamiti/0e126b7d88073a688102819edb06e8b4 to your computer and use it in GitHub Desktop.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment