There’s this common joke when studying linear algebra that goes like this. A student asks the teacher how do you visualize 4-dimensional spaces? To which the professor replies “Oh, I just …

I wrote in a previous post how transformers are kind of like system identification methods applied to some sequence in a state space. In this post we try to understand if the other way round is …

Transformer models have captivated a lot of AI research in most of the past decade, and in this post my goal is to make them seem more interesting to controls people, who have much to contribute to …

Consider an $$n+1$$ dimensional matrix as follows:

$$ A = \begin{pmatrix} \frac{\pi^2}{6} & 1 & \frac{1}{4} & ... & \frac{1}{n^2} \\ 1 & \frac{\pi^2}{6} & \frac{1}{4} & ... & \frac{1}{n^2} \\ \vdots & …

This blog post summarizes the papers Settling the Reward Hypothesis¹ and Utility Theory for Sequential Decision Making ².

The reward hypothesis is at the core of Reinforcement Learning (RL) in that …