Throughput llama 8b

workload	vanilla vLLM	nnsight eager	nnsight taps (CUDA graphs)	interp-engine vllm	interp-engine vllm-static	vLLM-Lens	vanilla vLLM 0.20.2	TransformerLens batched	TransformerLens (compile + CUDA graphs)
generate	92	86	89	86	90	86	92	✗	✗
generate, 8 concurrent	618	577	597	580	596	578	616	✗	✗
capture 1 layer, every step	·	79	89	84	89	75	·	✗	✗
capture every layer, every step	·	68	88	48	71	37	·	✗	✗
capture 1 layer, 8 concurrent	·	529	577	568	588	470	·	✗	✗
additive steering, 1 layer	·	78	89	85	89	49	·	✗	✗
logit lens every step	·	78	84	63	65	47	·	✗	✗
linear probe every step	·	78	89	84	89	49	·	✗	✗
zero one attention head every step	·	79	89	✗	✗	✗	·	✗	✗
override the sampled token every step	·	79	89	✗	✗	✗	·	✗	✗
one forward over 512 tokens, capture 1 layer	45 ms	53 ms	53 ms	43 ms	44 ms	45 ms	37 ms	98 ms	62 ms
sweep: 1024 × 1 token, capture 1 layer, per request	0.75 s	1.60 s	1.48 s	·	·	1.33 s	0.76 s	7.18 s	25.90 s
sweep: 1024 × 1 token, capture 1 layer, edit() once	·	1.09 s	1.00 s	·	·	✗	·	✗	✗