about « all posts

Posts In #state_space_models

Can LLM Finetuning be Stateful? Small states for Large Models - Part 2

Aug 7 2026 · 6 min read
#ml #controls #state_space_models #linear_algebra

The code for this project can be found at: https://github.com/omanshuthapliyal/HRM-adapter. And the paper can be found at: https://arxiv.org/pdf/2606.26290.

In the previous post, I introduced …

Read More…

Can LLM Finetuning be Stateful? Small states for Large Models - Part 1

Jul 31 2026 · 6 min read
#ml #controls #state_space_models #linear_algebra

In the last post I talked about Hankel operators of simple linear dynamical systems. Such operators, and either eigenvalues, “can be used as a proxy for how much memory a task actually …

Read More…

State Space Models: How Control Theory can echo Machine Learning

Oct 6 2025 · 6 min read
#ml #controls #state_space_models #linear_algebra

I wrote in a previous post how transformers are kind of like system identification methods applied to some sequence in a state space. In this post we try to understand if the other way round is …

Read More…