50 citations · 76 across the 5 of their papers we have counts for
5 papers
Optimal work extraction and mutual information in a generalized Szilárd engine
Juyong Song, Susanne Still, Rafael Díaz Hernández Rojas +2
A 1929 Gedankenexperiment proposed by Szilárd, often referred to as "Szilárd's engine", has served as a foundation for computing fundamental thermodynamic bounds to information pro…
Statistical Criticality arises in Most Informative Representations
Ryan John Cubero, Junghyo Jo, Matteo Marsili +2
We show that statistical criticality, i.e. the occurrence of power law frequency distributions, arises in samples that are maximally informative about the underlying generating pro…
Resolution and Relevance Trade-offs in Deep Learning
Juyong Song, Matteo Marsili, Junghyo Jo
Deep learning has been successfully applied to various tasks, but its underlying mechanism remains unclear. Neural networks associate similar inputs in the visible layer to the sam…
Causality inference in stochastic systems from neurons to currencies: Profiting from small sample size
Danh-Tai Hoang, Juyong Song, Vipul Periwal +1
Success in modeling complex phenomena such as human perception hinges critically on the availability of data and computational power. Significant progress has been made in modeling…
Minimal Perceptrons for Memorizing Complex Patterns
Marissa Pastor, Juyong Song, Danh-Tai Hoang +1
Feedforward neural networks have been investigated to understand learning and memory, as well as applied to numerous practical problems in pattern classification. It is a rule of t…