18 citations · 42 across the 7 of their papers we have counts for
7 papers
Broken Ergodicity and the Violation of the Fluctuation-Dissipation Theorem Lead to Generalization Beyond Overfitting in Machine Learning
Chan Li, Nigel Goldenfeld
The remarkable ability of modern neural networks to generalize improves with increasing network capacity, even when the number of model parameters or effective degrees of freedom e…
SwinYNet: A Transformer-based Multi-Task Model for Accurate and Efficient FRB Search
Yunchuan Chen, Shulei Ni, Chan Li +11
In this study, we present a transformer-based multi-task model for Fast Radio Burst (FRB) detection, signal segmentation, and parameter estimation directly from time-frequency data…
Meta predictive learning model of languages in neural circuits
Chan Li, Junbin Qiu, Haiping Huang
Large language models based on self-attention mechanisms have achieved astonishing performances not only in natural language itself, but also in a variety of tasks of different nat…
Statistical mechanics of continual learning: variational principle and mean-field potential
Chan Li, Zhenye Huang, Wenxuan Zou +1
An obstacle to artificial general intelligence is set by continual learning of multiple tasks of different nature. Recently, various heuristic tricks, both from machine learning an…
Emergence of hierarchical modes from deep learning
Chan Li, Haiping Huang
Large-scale deep neural networks consume expensive training costs, but the training results in less-interpretable weight matrices constructing the networks. Here, we propose a mode…
Ensemble perspective for understanding temporal credit assignment
Wenxuan Zou, Chan Li, Haiping Huang
Recurrent neural networks are widely used for modeling spatio-temporal sequences in both nature language processing and neural population dynamics. However, understanding the tempo…
Learning credit assignment
Chan Li, Haiping Huang
Deep learning has achieved impressive prediction accuracies in a variety of scientific and industrial domains. However, the nested non-linear feature of deep learning makes the lea…