36 resources

Zoom In: An Introduction to Circuits

Chris Olah, Nick Cammarata, Ludwig Schubert, Gabriel Goh, Michael Petrov, Shan Carter, Distill, 2020

A highly visual introduction to the idea that neural networks can be understood in terms of features and the circuits that connect them, using examples from an image classifier.

ExplainerIntroductoryAbout 1 hour

Toy Models of Superposition

Nelson Elhage, Tristan Hume, Catherine Olsson, et al., Transformer Circuits Thread, 2022

Uses small synthetic models to show how networks can represent more features than they have dimensions by storing them in superposition, and maps when and how this happens.

Research paperAdvancedAbout 5 hours

TransformerLens

Neel Nanda and open-source contributors, GitHub, 2022

A Python library for mechanistic interpretability of GPT-style language models that makes it easy to cache, inspect and edit internal activations.

Code repositoryIntermediateA few hours to get started

Holistic Evaluation of Language Models (HELM)

Percy Liang, Rishi Bommasani, Tony Lee, et al., Transactions on Machine Learning Research, 2022

Evaluates many language models across a broad set of scenarios and several metrics at once — including calibration, robustness, fairness, bias and toxicity — rather than accuracy alone.

BenchmarkIntermediateAbout 3 hours