Activation Patching Python Packages

pyvene

Stanford NLP Python library for understanding and improving PyTorch models via interventions

neuronscope-cli

CLI and MCP server that traces which attention heads and neurons drive an LLM's output, built on TransformerLens.