GarrickLin

GarrickLin / any_gateway

Public

A light-weight self-hosted AI API gateway that proxies requests to multiple backend providers (OpenAI, Anthropic, Gemini) with user management, quota control, and audit logging.

13
0
100% credibility
Found Mar 13, 2026 at 13 stars -- GitGems finds repos before they trend. Get early access to the next one.
Sign Up Free
AI Analysis
Python
AI Summary

A self-hosted gateway that routes AI requests to multiple providers including OpenAI, Anthropic, and Gemini, featuring user management, quota controls, load balancing, and audit logging via a React dashboard.

How It Works

1
🔍 Discover Any Gateway

You find this handy tool to manage and share access to different AI services from one place, keeping everything organized and secure.

2
🚀 Set it up quickly

With a simple download and one-click launch, your personal AI hub is ready on your computer or server in minutes.

3
🔗 Connect your AI accounts

Link your favorite AI services like chat helpers from various companies so requests can flow smoothly between them.

4
👥 Organize users and teams

Create groups for your team or family, assign permissions, and set spending limits to stay in control.

5
🔑 Generate secure access passes

Make private passwords for everyone, each with custom limits, so they can use the AI without sharing full accounts.

6
💬 Start chatting with AI

Use the built-in chat or connect your apps, watching requests route smartly with real-time tracking.

📊 Enjoy full oversight

View dashboards, logs, and reports to monitor usage, costs, and activity, feeling confident everything is safe and efficient.

Sign up to see the full architecture

5 more

Sign Up Free

Star Growth

See how this repo grew from 13 to 13 stars Sign Up Free
Repurpose This Repo

Repurpose is a Pro feature

Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.

Unlock Repurpose
AI-Generated Review

What is any_gateway?

Any_gateway is a light-weight, self-hosted API gateway that proxies AI requests to backends like OpenAI, Anthropic, and Gemini, with automatic protocol detection for seamless OpenAI-compatible, Anthropic messages, or Gemini endpoints. It handles user management via LDAP or fallback auth, issues sk-* API keys with per-key quotas and expiration, enforces rate limits via Redis, and provides audit logging in compressed daily JSONL files. A React dashboard lets you manage channels, groups, tokens, users, and view stats/logs—all in Python with Docker support.

Why is it gaining traction?

Unlike heavy cloud gateways, this any gateway offers weighted load balancing across providers, group-based access control with priority routing, and streaming SSE passthrough without blocking—ideal for multi-vendor setups. Devs dig the quota control per token or user balance, RBAC for admins, and non-blocking async logging that scales under load. It's a practical any API gateway any method, dodging vendor lock-in while adding enterprise audit and control.

Who should use this?

DevOps teams proxying internal AI traffic across Anthropic, Gemini, and OpenAI backends need its light-weight routing and LDAP integration. Small orgs managing shared API keys with quotas/rate limits will value the dashboard for tokens, groups, and logs. Self-hosters tired of per-provider clients fit perfectly for unified /v1/chat/completions access.

Verdict

Try it for prototyping multi-provider AI gateways—solid features and Docker quickstart shine despite 13 stars and 1.0% credibility score signaling early maturity. Docs are clear with API refs, but add tests and pricing logic for production; great for light-weight audit/logging needs now.

(198 words)

Sign up to read the full AI review Sign Up Free

Similar repos coming soon.