5 papers
On the Superlinear Relationship between SGD Noise Covariance and Loss Landscape Curvature
Yikuan Zhang, Ning Yang, Yuhai Tu
Stochastic Gradient Descent (SGD) introduces anisotropic noise that is correlated with the local curvature of the loss landscape, thereby biasing optimization toward flat minima. P…
Noise-Driven Exploration and Transient Freezing Select Flat Minima in Stochastic Gradient Descent
Ning Yang, Yikuan Zhang, Qi Ouyang +2
Stochastic gradient descent (SGD) is central to deep learning, yet the dynamical origin of its preference for flatter, more generalizable solutions remains unclear. Here, by analyz…
An altruistic resource-sharing mechanism for synchronization: The energy-speed-accuracy tradeoff
Dongliang Zhang, Yuansheng Cao, Qi Ouyang +1
Synchronization among a group of active agents is ubiquitous in nature. Although synchronization based on direct interactions between agents described by the Kuramoto model is well…
Geometry of optimal control in chemical reaction networks
Yikuan Zhang, Qi Ouyang, Yuhai Tu
Although optimal control (OC) has been studied in stochastic thermodynamics for systems with continuous state variables, less is known in systems with discrete state variables, suc…
Temperature Compensation through Kinetic Regulation in Biochemical Oscillators
Haochen Fu, Chenyi Fei, Qi Ouyang +1
Nearly all circadian clocks maintain a period that is insensitive to temperature changes, a phenomenon known as temperature compensation (TC). Yet, it is unclear whether there is a…