Showing 2025Show all
3 papers · 1 filter
cs.LG2025
The Effect of Label Noise on the Information Content of Neural Representations
Ali Hussaini Umar, Franky Kevin Nando Tezoh, Jean Barbier +2
In supervised classification tasks, models are trained to predict a label for each data point. In real-world datasets, these labels are often noisy due to annotation errors. While…
math.ST2025
Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime
Francesco Camilli, Daria Tieplova, Eleonora Bergamin +1
We rigorously analyse fully-trained neural networks of arbitrary depth in the Bayesian optimal setting in the so-called proportional scaling regime where the number of training sam…
cs.IT2025
Information-theoretic limits and approximate message-passing for high-dimensional time series
Daria Tieplova, Samriddha Lahiry, Jean Barbier
High-dimensional time series appear in many scientific setups, demanding a nuanced approach to model and analyze the underlying dependence structure. Theoretical advancements so fa…