llm-server-docs

varunvasudeva1/llm-server-docs
★ 721 stars Unknown language 🤖 AI/LLM Updated 1mo ago
End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.
View on GitHub →

Quick Install

Copy the config for your editor. Some servers may need additional setup — check the README.

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "llm-server-docs": {
      "command": "npx",
      "args": [
        "-y",
        "varunvasudeva1/llm-server-docs"
      ]
    }
  }
}

Topics

comfyuidebiandockerhuggingfacekokoro-fastapilinuxllama-swapllamacppllmmcp-proxymcpjungleollamaopen-webuivllm