Skip to content

Instantly share code, notes, and snippets.

@mkwatson

mkwatson/CommonAI.md

Created June 7, 2025 01:20
Show Gist options
  • Save mkwatson/7d36f264ea458edb85338a4c4ee96032 to your computer and use it in GitHub Desktop.
Save mkwatson/7d36f264ea458edb85338a4c4ee96032 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
CommonAI.md

The problem:

Every time someone builds an AI-powered app or website, they hit the same crossroads. Either they bolt an LLM key into front-end code, risking leaks, surprise bills, and instant compliance red flags, or they stop progress to write a custom mini-backend that hides keys, authenticates users, meters usage, and logs every prompt. Every new project does this from scratch.

Let's build that layer once, open-source it so the whole ecosystem can stop duplicating effort. Install a tiny SDK, drop in the team's own OpenAI, Anthropic, or Cohere key, and call the model: the gateway stores secrets, authenticates each request, enforces per-user limits, records full audit logs, and lets developers switch providers without touching front-end code.

Stripe removed the need to build payment rails and Auth0 removed the need to build login flows. This removes the need to build AI plumbing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment