A Privileged Basis for the Recurrent State of SSMs
This post describes ongoing research. Preliminary code is available in ssm-interp and ssm-interp-runs, and the per-layer statistics are on Hugging Face. Most of the tools we use to look inside …
This post describes ongoing research. Preliminary code is available in ssm-interp and ssm-interp-runs, and the per-layer statistics are on Hugging Face. Most of the tools we use to look inside …
Part 1: https://omanshuthapliyal.github.io/blog/is-it-a-cartel/ The code and data for this project can be found at: https://github.com/omanshuthapliyal/llm-collusion-audit. In the previous post, I …
In April this year, a small café opened on Norrbackagatan in Stockholm with a rather unusual manager. The baristas are human, but most of the decisions behind the counter are made by an AI agent …
I recently finished BlueDot’s Technical AI Safety course. The reading list is long. Read one unit at a time, it is easy to lose the shape of the whole. So I did what one does with a pile of …
Terrible pun aside, I realized that I had recently completed 10 years of listening on Spotify and wanted to dig a little bit into my listening habits, especially how they have evolved over time. …
Part 1:https://omanshuthapliyal.github.io/blog/hrt-conjecture/ Part 2: https://omanshuthapliyal.github.io/blog/hrt-conjecture-part-2/ In the (last couple) (of posts) I explained what the recently …