LocalAI

The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, MCP, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference

{
  "mcpServers": {
    "localai": {
      "command": "go",
      "args": [
        "run",
        "github.com/mudler/LocalAI@latest"
      ]
    }
  }
}

claude mcp add localai go run github.com/mudler/LocalAI@latest

{
  "mcpServers": {
    "localai": {
      "command": "go",
      "args": [
        "run",
        "github.com/mudler/LocalAI@latest"
      ]
    }
  }
}