bifrost
StandardBifrost is a high-performance LLM gateway with adaptive load balancing, cluster mode, and guardrails. It supports 1000+ models and offers <100 µs overhead at 5k RPS. Connects to various LLMs and provides fast, scalable inference for AI agents. Ideal for developers building LLM-powered applications needing high throughput and low latency.
1,8501990Updated 1 month ago
Overview
Bifrost is a high-performance LLM gateway with adaptive load balancing, cluster mode, and guardrails. It supports 1000+ models and offers <100 µs overhead at 5k RPS. Connects to various LLMs and provides fast, scalable inference for AI agents. Ideal for developers building LLM-powered applications needing high throughput and low latency.
Installation
1Install the package
2Add to Claude
Add this configuration to your claude_desktop_config.json:
claude_desktop_config.json
{
"mcpServers": {
"maximhq-bifrost-github": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-maximhq-bifrost-github"
]
}
}
}3Verify installation
Restart Claude Desktop, then ask:
"What tools do you have available from bifrost?"
Prerequisites
- Node.js 18 or higher
- npm or npx available
- Claude Desktop or Claude API access
- API key for bifrost
Configuration
API Key Required
This server requires an API key from bifrost. Add it to your environment or config.
| Variable | Required | Description |
|---|---|---|
| BIFROST_API_KEY | Yes | Your bifrost API key |
Usage Examples
List Resources
"What resources are available in bifrost?"
Claude will query available resources and return a list of what you can access.
Get Details
"Show me details about [specific item] in bifrost"
Claude will fetch and display detailed information about the requested item.
Create New
"Create a new [item] in bifrost with [details]"
Claude will use the appropriate tool to create the resource and confirm success.
Works with bifrost
Related skills
Browse all skillsNeed help with MCP integration?
We build custom MCP integrations for B2B companies. From simple connections to complex multi-tool setups.