3 papers
cs.LG2026
Decomposing Prediction Mechanisms for In-Context Recall
Sultan Daniels, Dylan Davis, Dhruv Gautam +3
We introduce a new family of toy problems that combine features of linear-regression-style continuous in-context learning (ICL) with discrete associative recall. We pretrain transf…
cond-mat.stat-mech2026
The Thermodynamic Costs of Simple Linear Regression
Samuel H. D'Ambrosia, Sultan M. Daniels, Michael R. DeWeese +1
The construction of models from data is a significant contributor to the energetic costs of computation. Because of this, understanding how foundational thermodynamic bounds apply…
cs.IT2026
The Entropy of Floating-Point Numbers
Sultan Daniels, Samuel H. D'Ambrosia, Michael R. DeWeese +1
Here we present an analytic approximation for the entropy of floating-point numbers, along with bounds on the error of this approximation. It is well-known that the differential en…