caix

RedHillsMediaFL/caix

★ 1 stars Swift AI/LLM Updated today

caix — native Apple Core AI inference server for Apple silicon (beta): OpenAI/Anthropic API, dashboard, streaming chat with tools/skills/MCP, MTP speculative decoding.

View on GitHub → Try with Claude — $10 free →

Quick Install

Copy the config for your editor. Some servers may need additional setup — check the README.

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "caix": {
      "command": "npx",
      "args": [
        "-y",
        "RedHillsMediaFL/caix"
      ]
    }
  }
}

README Excerpt

> **BETA.** caix is beta software and will remain so until Apple's **Core AI** runtime leaves > beta. Things may change; expect rough edges. It runs entirely on your Mac — no data leaves the > device. **caix** runs large language models *natively* on Apple silicon through Apple's **Core AI** runtime (Neural Engine + GPU), and serves them behind:

Tools (1)

CAIX_EXPORT_INDEX

Topics

anthropic-apiapple-siliconcoremlinference-serverllmllm-inferencelocal-llmmacosmlxneural-engineollama-alternativeon-device-aiopenai-apispeculative-decodingswift

caix

Quick Install

README Excerpt

Tools (1)

Topics

Related AI/LLM Servers