evals-mcp-server

cyanheads/evals-mcp-server

★ 1 stars TypeScript Security Updated 15d ago

Author verifiable eval records through a draft → review → revise → submit loop with server-enforced graders; compile to JSONL/CSV/Inspect/lm-eval via MCP. STDIO or Streamable HTTP.

View on GitHub → 🔍 Audit Wallet Slippage →

Quick Install

Copy the config for your editor. Some servers may need additional setup — check the README.

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "cyanheads/evals-mcp-server"
      ]
    }
  }
}

Topics

cyanheadsevalsevaluationgraderinspect-ailm-eval-harnessmcpmodel-context-protocolrlvrtypescriptverifiable-rewards

evals-mcp-server

Quick Install

Topics

Related Security Servers