End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.
View on GitHub →
Try with Claude — $10 free →
Quick Install
Copy the config for your editor. Some servers may need additional setup — check the README.
Claude Desktop
Claude Code
Cursor
Add to claude_desktop_config.json:
{
"mcpServers": {
"llm-server-docs": {
"command": "npx",
"args": [
"-y",
"varunvasudeva1/llm-server-docs"
]
}
}
}📋 Copy
Run in terminal:
claude mcp add llm-server-docs npx -y varunvasudeva1/llm-server-docs📋 Copy
Add to .cursor/mcp.json:
{
"mcpServers": {
"llm-server-docs": {
"command": "npx",
"args": [
"-y",
"varunvasudeva1/llm-server-docs"
]
}
}
}📋 Copy
Topics
comfyui debian docker huggingface kokoro-fastapi linux llama-swap llamacpp llm mcp-proxy mcpjungle ollama open-webui vllm