Amazon Bedrock provides OpenAI compatible API endpoints for model inference, powered by Mantle, a distributed inference engine for large-scale machine learning model serving. Mantle is designed with Zero Operator Access required - which basically means there is no technical way for an AWS operator to access the systems that power Mantle - everything is managed via automation. See blog for details https://aws.amazon.com/blogs/machine-learning/exploring-the-zero-operator-access-design-of-mantle/.
User guide and API info here https://docs.aws.amazon.com/bedrock/latest/userguide/bedrock-mantle.html
Supported regions - ensure you call the correct endpoint for the region you want: https://docs.aws.amazon.com/bedrock/latest/userguide/bedrock-mantle.html#bedrock-mantle-supported
Below I use glow for printing nicely the markdown the LLM gives you. Install for your platform https://github.com/charmbracelet/glow
Also use uv for painless Python scripts.