Production-grade MCP server that exposes AI agent quality evaluation (RAGAS faithfulness, precision, recall, response relevancy + custom JSON trace eval).
Quick Install
Copy the config for your editor. Some servers may need additional setup — check the README.
Add to claude_desktop_config.json:
{
"mcpServers": {
"agent-eval-mcp-serve": {
"command": "uvx",
"args": [
"agent-eval-mcp-server"
]
}
}
}
Run in terminal:
claude mcp add agent-eval-mcp-serve uvx agent-eval-mcp-server
Add to .cursor/mcp.json:
{
"mcpServers": {
"agent-eval-mcp-serve": {
"command": "uvx",
"args": [
"agent-eval-mcp-server"
]
}
}
}
Or install with pip: pip install agent-eval-mcp-server