llauncher

shanevcantwell/llauncher

★ 0 stars Python 🤖 AI/LLM Updated today

llama-server model endpoint manager with JiT swapping with human UI, MCP and pi extension support.

View on GitHub →

Quick Install

Copy the config for your editor. Some servers may need additional setup — check the README.

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "llauncher": {
      "command": "uvx",
      "args": [
        "llauncher"
      ]
    }
  }
}

Or install with pip: pip install llauncher

README Excerpt

An MCP-first launcher and management tool for llama.cpp `llama-server` instances. Designed for both programmatic control via LLMs and human operators via a web UI. Full programmatic control for LLM agents and automation: - **List models** with current status (running/stopped) - **Start/stop servers** with validation and audit logging

Tools (14)

LAUNCHER_AGENT_HOSTLAUNCHER_AGENT_NODE_NAMELAUNCHER_AGENT_PORTadd_modelget_model_configget_server_logslist_modelsremove_modelserver_statusstart_serverstop_serverswap_serverupdate_model_configvalidate_config

Topics

agentic-aiagentic-workflowaillama-cppllama-serverllmmcpmcp-serverpi-harnesspythonserver-admin

llauncher

Quick Install

README Excerpt

Tools (14)

Topics

Related AI/LLM Servers