Skip to content

Instantly share code, notes, and snippets.

@velotiotech
Created August 8, 2025 06:24
Show Gist options
  • Select an option

  • Save velotiotech/468d5024fdafda56feb6ee4416003810 to your computer and use it in GitHub Desktop.

Select an option

Save velotiotech/468d5024fdafda56feb6ee4416003810 to your computer and use it in GitHub Desktop.
INFERENCE_MODE="<ollama|aws_bedrock>"
# For local inference
OLLAMA_URL="http://localhost:11434"
# For Bedrock inference
BEDROCK_FLOW_IDENTIFIER="<flow ID or ARN>"
BEDROCK_FLOW_ALIAS="<alias name or ARN>"
AWS_REGION="us-east-1"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment