4 papers · 1 filter
Learning and Control Beyond Linearity: Towards a Non-asymptotic Theory for Bilinear Systems
Yahya Sattar, Yassir Jedra, Robin Strässer +3
This tutorial provides a unified view of the emerging area of bilinear learning and control. Using linear systems as a benchmark, it explains what fundamentally changes in the bili…
Extracting Algorithms in Pre-trained LLMs: A Case on Hidden Markov Models
Yijia Dai, Zhaolin Gao, Yahya Sattar +2
Large language models (LLMs) display a striking ability to predict next observations from Hidden Markov Models (HMMs) via in-context learning (ICL), but the algorithm underlying th…
Two-Layer Linear Auto-Regressive Models Estimate Latent States
Yahya Sattar, Sunmook Choi, Leo Maynard-Zhang +3
Auto-regressive models have emerged as powerful tools for sequential data, from language to video. Understanding how and why these models learn latent representations remains an op…
Dual Control of Linear Systems from Bilinear Observations with Belief Space Model Predictive Control
Daniel Cao, Beixi Du, Andrew Lowitt +3
We study finite-horizon quadratic control of linear systems with bilinear observations, in which the control input affects not only the state dynamics but also the partial observat…