litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

{
  "mcpServers": {
    "litellm": {
      "command": "uvx",
      "args": [
        "litellm"
      ]
    }
  }
}

claude mcp add litellm uvx litellm

{
  "mcpServers": {
    "litellm": {
      "command": "uvx",
      "args": [
        "litellm"
      ]
    }
  }
}