Skip to main content

Ml

What Hankel Spectra Reveal About Memory

Suppose we are given a linear dynamical system $$G=(A,B,C,D)$$ (recall that a linear system is an input $$x$$ to output $$y$$ map such that $$y_k = Cx_k + Du_k, x_{k+1}=Ax_k+Bu_k$$), and $$G$$ has …

Why are Gaussian distributions present Everywhere?

Well, if one were to cut to the chase, it appears to be because of the Central Limit Theorem (CLT). However, there is more underlying structure under the hood as to why the Gaussians seem to be the …

How Transformers Echo Control Theory

Transformer models have captivated a lot of AI research in most of the past decade, and in this post my goal is to make them seem more interesting to controls people, who have much to contribute to …

Technology Readiness Levels of AI methods

Recent news of the SpaceX catching its Starship Super Heavy booster1 is quite discussed and marveled upon in the media, and rightly so. Executing what was done can perhaps be explained as trying to …

MLP Approximation

Almost always we hear about classification or machine learning problems, the go-to methods to solve the problem are neural networks, or multi-layered percetrons (MLP). Now function approximation …

ML SoTA Resources

The internet is filled with machine learning resources, and one of the most annoying things about them is the sheer volume. There are many attempts at making compilations of papers, code, and current …