agent-eval-mcp

mrd5591/agent-eval-mcp
★ 0 stars Python Code/Dev Tools Updated today
Measure what a coding agent actually did: tool efficiency, loops, test outcomes and cost, from session transcripts. CLI and MCP server.
View on GitHub → 🔍 Audit Wallet Slippage →

Quick Install

Copy the config for your editor. Some servers may need additional setup — check the README.

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "agent-eval-mcp": {
      "command": "uvx",
      "args": [
        "agent-eval-mcp"
      ]
    }
  }
}

Or install with pip: pip install agent-eval-mcp

README Excerpt

Measure what a coding agent actually did. Tool efficiency, loops, test outcomes, permission posture and cost, read out of session transcripts. Ships as a CLI and as an MCP server. ```bash uv pip install -e . agent-eval sessions # what sessions exist agent-eval analyze path/to/session.jsonl # what happened in one