2 papers
cs.LG2025
Multiple Descents in Deep Learning as a Sequence of Order-Chaos Transitions in LSTM Networks
Wenbo Wei, Fan Xu, Nicholas Chong Jia Le +2
We observe a novel `multiple-descent' phenomenon during the learning process of a recurrent neural network called long-short-term memory (LSTM) networks during its training on real…
physics.data-an2023
Self-Organization Towards Noise in Deep Neural Networks
Nicholas Chong Jia Le, Ling Feng
The presence of noise, also known as pink noise, is a well-established phenomenon in biological neural networks, and is thought to play an important role in information proce…