NeuronScope

RudrenduPaul/NeuronScope
★ 0 stars Python AI/LLM Updated today
CLI and MCP server for mechanistic interpretability: trace which attention heads and neurons drive an LLM's output, built on TransformerLens. Schema-versioned JSON output, agent-callable via MCP, activation patching, zero-ablation, circuit sketches for GPT-2, Llama, Gemma, Qwen, Pythia and 240+ open-weight models.
View on GitHub → 🔍 Audit Wallet Slippage →

Quick Install

Copy the config for your editor. Some servers may need additional setup — check the README.

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "neuronscope": {
      "command": "uvx",
      "args": [
        "neuronscope"
      ]
    }
  }
}

Or install with pip: pip install neuronscope

README Excerpt

Ask a language model "why did you say that" and get back the actual attention heads and neurons responsible, as JSON, from the command line or from an agent over MCP. Not on PyPI yet, so install from source: ```bash git clone https://github.com/RudrenduPaul/NeuronScope cd NeuronScope pip install -e .

Topics

activation-patchingai-agentsai-safetycliexplainable-aiinterpretabilityllmmcpmechanistic-interpretabilitymodel-context-protocolneural-networksopen-sourcepytorchtransformertransformerlens