796 citations · 2k across the 29 of their papers we have counts for
4 papers · 1 filter
Multiscale Relevance of Natural Images
Samy Lakhal, Alexandre Darmon, Iacopo Mastromatteo +2
We use an agnostic information-theoretic approach to investigate the statistical properties of natural images. We introduce the Multiscale Relevance (MSR) measure to assess the rob…
Maximal Relevance and Optimal Learning Machines
O Duranthon, M Marsili, R Xie
We show that the mutual information between the representation of a learning machine and the hidden features that it extracts from data is bounded from below by the relevance, whic…
The peculiar statistical mechanics of Optimal Learning Machines
Matteo Marsili
Optimal Learning Machines (OLM) are systems that extract maximally informative representation of the environment they are in contact with, or of the data they are presented. It has…
Statistical Criticality arises in Most Informative Representations
Ryan John Cubero, Junghyo Jo, Matteo Marsili +2
We show that statistical criticality, i.e. the occurrence of power law frequency distributions, arises in samples that are maximally informative about the underlying generating pro…