Tutorials

Walkthrough

Learn the basics

notebooks/tutorials/walkthrough.ipynb

Activation Patching

Causal intervention

notebooks/tutorials/activation_patching.ipynb

Attribution Patching

Approximate patching

notebooks/tutorials/attribution_patching.ipynb

Boundless DAS

Identifying Causal Mechanisms in Alpaca

notebooks/tutorials/boundless_DAS.ipynb

Dictionary Learning

Sparse autoencoders

notebooks/tutorials/dict_learning.ipynb

Logit Lens

Decode activations

notebooks/tutorials/logit_lens.ipynb

• Activation Patching
• Attribution Patching
• Setup (Ignore)
• Boundless DAS
• Setup (Ignore)
• Price Tagging game
• Prealign Task
• Boundless DAS
• Dictionary Learning
• Logit Lens
• Setup (Ignore)
• GPT2 Model Architecture
• Walkthrough
• 1️⃣ First, let’s start small
• 2️⃣ Bigger
• 3️⃣ I thought you said huge models?
• Getting Involved!