Tutorials

Walkthrough

Learn the basics

notebooks/tutorials/walkthrough.ipynb

Activation Patching

Causal intervention

notebooks/tutorials/activation_patching.ipynb

Attribution Patching

Approximate patching

notebooks/tutorials/attribution_patching.ipynb

Boundless DAS

Identifying Causal Mechanisms in Alpaca

notebooks/tutorials/boundless_DAS.ipynb

Dictionary Learning

Sparse autoencoders

notebooks/tutorials/dict_learning.ipynb

Logit Lens

Decode activations

notebooks/tutorials/logit_lens.ipynb

LoRA

Fine tuning for sentiment analysis

notebooks/tutorials/LoRA_tutorial.ipynb

• LoRA for Sentiment Analysis
• Setup
• Prepare Data
• Prepare our Model
• LLM Fine Tuning
• Activation Patching
• Set Up
• Patching Experiment
• Limitations
• Trying on a bigger model
• Attribution Patching
• Boundless DAS
• Setup (Ignore)
• Price Tagging game
• Prealign Task
• Boundless DAS
• Dictionary Learning
• Setup
• Apply SAE
• Logit Lens
• Walkthrough
• 1️⃣ First, let’s start small
• 2️⃣ Bigger
• 3️⃣ I thought you said huge models?
• Next Steps
• Getting Involved!