intent-eval-lab

jeremylongshore/intent-eval-lab
★ 0 stars Shell 🤖 AI/LLM Updated today
Vendor-neutral research umbrella for measuring AI plugin, agent, and MCP server quality across CLI runtimes (Claude Code, Gemini CLI, Copilot CLI, Codex CLI).
View on GitHub →

Quick Install

Copy the config for your editor. Some servers may need additional setup — check the README.

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "intent-eval-lab": {
      "command": "npx",
      "args": [
        "-y",
        "jeremylongshore/intent-eval-lab"
      ]
    }
  }
}

Topics

agent-evalai-evaluationclaude-codecross-cligemini-cliinvocation-ratemcpopentelemetryplugin-testingskill-discovery