Skip to content

Instantly share code, notes, and snippets.

@sofianhamiti
Last active April 10, 2025 12:00
Show Gist options
  • Save sofianhamiti/bf77f0f4691e2067b8ea487bfdb9fa8b to your computer and use it in GitHub Desktop.
Save sofianhamiti/bf77f0f4691e2067b8ea487bfdb9fa8b to your computer and use it in GitHub Desktop.
# LiteLLM Configuration (see https://docs.litellm.ai/docs/proxy/config_settings)
# -----------------------------------------------------
# General application settings - Using Environment Variables from ECS Fargate
# -----------------------------------------------------
general_settings:
store_prompts_in_spend_logs: true
master_key: os.environ/LITELLM_MASTER_KEY
salt_key: os.environ/LITELLM_SALT_KEY
database_url: os.environ/DATABASE_URL
store_model_in_db: true
disable_spend_logs: true
# -----------------------------------------------------
# Model Configuration - (see https://docs.litellm.ai/docs/providers/bedrock for Bedrock details)
# -----------------------------------------------------
model_list:
- model_name: "claude-3-7"
litellm_params:
model: "bedrock/us.anthropic.claude-3-7-sonnet-20250219-v1:0" # Example using Claude 3.7 inference profile
aws_region_name: os.environ/AWS_REGION
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment