99 citations · 196 across the 7 of their papers we have counts for
7 papers
Random-Energy Secret Sharing via Extreme Synergy
Vudtiwat Ngampruetikorn, David J. Schwab
The random-energy model (REM), a solvable spin-glass model, has impacted an incredibly diverse set of problems, from protein folding to combinatorial optimization to many-body loca…
Extrinsic vs Intrinsic Criticality in Systems with Many Components
Vudtiwat Ngampruetikorn, Ilya Nemenman, David J. Schwab
Biological systems with many components often exhibit seemingly critical behaviors, characterized by atypically large correlated fluctuations. Yet the underlying causes remain uncl…
Generalized Information Bottleneck for Gaussian Variables
Vudtiwat Ngampruetikorn, David J. Schwab
The information bottleneck (IB) method offers an attractive framework for understanding representation learning, however its applications are often limited by its computational int…
Information bottleneck theory of high-dimensional regression: relevancy, efficiency and optimality
Vudtiwat Ngampruetikorn, David J. Schwab
Avoiding overfitting is a central challenge in machine learning, yet many large neural networks readily achieve zero training loss. This puzzling contradiction necessitates new app…
Emergence of local irreversibility in complex interacting systems
Christopher W. Lynn, Caroline M. Holmes, William Bialek +1
Living systems are fundamentally irreversible, breaking detailed balance and establishing an arrow of time. But how does the evident arrow of time for a whole system arise from the…
Decomposing the local arrow of time in interacting systems
Christopher W. Lynn, Caroline M. Holmes, William Bialek +1
We show that the evidence for a local arrow of time, which is equivalent to the entropy production in thermodynamic systems, can be decomposed. In a system with many degrees of fre…