bifrost

by maximhq · Go · ★ 4,470

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

#ai-gateway#gateway#gateway-services#generative-ai#guardrails#llm#llm-cost#llm-gateway#llm-observability#llmops#load-balancing#mcp-client#mcp-gateway#mcp-server#model-router#token-management

Install

go install github.com/maximhq/bifrost@latest

Claude Desktop config

Add this to your claude_desktop_config.json:

{
  "mcpServers": {
    "bifrost": {
      "command": "npx",
      "args": [
        "-y",
        "github:maximhq/bifrost"
      ]
    }
  }
}

From the README

[](https://goreportcard.com/report/github.com/maximhq/bifrost/core) [](https://discord.gg/exN5KAydbU) [](https://codecov.io/gh/maximhq/bifrost) [](https://app.getpostman.com/run-collection/31642484-2ba0e658-4dcd-49f4-845a-0c7ed745b916?action=collection%2Ffork&source=rip_markdown&collection-url=entityId%3D31642484-2ba0e658-4dcd-49f4-845a-0c7ed745b916%26entityType%3Dcollection%26workspaceId%3D63e853c8-9aec-477f-909c-7f02f543150e) [](https://artifacthub.io/packages/search?repo=bifrost) [](LICENSE) Bifrost is a high-performance AI gateway that unifies access to 15+ providers (OpenAI, Anthropic,…

Read full README on GitHub →

💡 Need a managed MCP host?

Try Claude Pro for the smoothest MCP experience, or browse our cloud-hosted servers.

Related cloud & devops servers

lobehub

★ 75,886

The ultimate space for work and life — to find, build, and collaborate with agent teammates that grow with you. We are taking agent harness to the next level — enabling multi-agent collaboration, effortless agent team design, and introducing agents as the unit of work interaction.

Cloud & DevOps · TypeScript

TrendRadar

sansan0

★ 55,887

⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载，你的 AI 舆情监控助手与热点筛选工具！聚合多平台热点 + RSS 订阅，支持关键词精准筛选。AI 智能筛选新闻 + AI 翻译 + AI 分析简报直推手机，也支持接入 MCP 架构，赋能 AI 自然语言对话分析、情感洞察与趋势预测等。支持 Docker ，数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/bark/slack 等渠道智能推送。

Cloud & DevOps · Python

litellm

BerriAI

★ 45,311

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Cloud & DevOps · Python

kong

Kong

★ 43,294

🦍 The API and AI Gateway

Cloud & DevOps · Lua

LibreChat

danny-avila

★ 36,326

Enhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, Code Interpreter, langchain, DALL-E-3, OpenAPI Actions, Functions, Secure Multi-User Auth, Presets, open-source for self-hosting. Active.

Cloud & DevOps · TypeScript

PDFMathTranslate

★ 33,434

[EMNLP 2025 Demo] PDF scientific paper translation with preserved formats - 基于 AI 完整保留排版的 PDF 文档全文双语翻译，支持 Google/DeepL/Ollama/OpenAI 等服务，提供 CLI/GUI/MCP/Docker/Zotero

Cloud & DevOps · Python