Skip to main content

State-Space-Models

Mechanistic Interpretability of State Space Models

Using control theory to say which part of a state space model's recurrent state carries a behaviour: directions ranked by how strongly the past writes them and the future reads them, tested by removing a direction at every step.

Provable Safety and Efficient Memory for Language Models

Using control theory to make language-model components predictable enough for safety-critical deployment: safety classifiers that can prove their decisions, and fine-tuning adapters whose memory can be analyzed and compressed with guarantees.