engine

engine

NNsightLLMEngine

Bases: LLMEngine

Custom vLLM engine that collects saved intervention results from finished requests.

After each engine step, finished requests are forwarded to the model runner's finish_nnsight() method to gather any variables that were .save()-ed during intervention execution.

step

step()