A Privileged Basis for the Recurrent State of SSMs
This post describes ongoing research. Preliminary code is available in ssm-interp and ssm-interp-runs, and the per-layer statistics are on Hugging Face. Most of the tools we use to look inside …
Interpretability
A Probe Knows More Than the Model Says
Written for Apart Research’s Digital Minds Research Sprint. The report and code are linked at the end, and Do Language Models Mean What They Choose? covers my other project from the same sprint. …