5 papers
In-context classification: Calibration and noise in linear attention with softmax readout
Arman Rysmakhanov, Mary Letey, Yue M. Lu +2
We study in-context binary classification in a simple attention model trained to minimise a logistic loss. Each prompt has a latent logistic teacher, and the learner must infer its…
What can linear attention learn from nonlinear teachers in-context?
Mary Letey, Arman Rysmakhanov, Yue M. Lu +2
Linear attention is a tractable model for understanding the mechanisms governing in-context learning in transformers. For linear regression tasks, recent asymptotic analyses have c…
Spectral Properties of Dense Barabási-Albert Graphs
Steven J. Miller, Arman Rysmakhanov
Preferential attachment graphs model networks whose growth produces highly uneven degree distributions, describing many real-world systems. Their adjacency spectra are important be…
Properties of Multidimensional Vector Zeckendorf Representations
Ivan Bortnovskyi, June Duvivier, Pedro Espinosa +7
Zeckendorf's Theorem says that for all , every nonnegative integer has a unique -Zeckendorf representation as a sum of distinct -bonacci numbers, where no conse…
Comparing Left and Right Quotient Sets in Groups
Julian Duvivier, Xiaoyao Huang, Ava Kennon +5
For a finite subset of a group , we define the right quotient set and the left quotient set of , respectively, as , $A^{-1}A := \…