4 papers · 1 filter
Drift and Dependence: Layer-wise Information-Theoretic Bounds for Replay-Based Continual Learning
Tieliang Gong, Zhongbo Zhang, Wen Wen +1
Continual learning must absorb new tasks without erasing old ones, and replay---mixing a small buffer of past examples into current training---is among the most effective remedies…
Controlled Dynamics Attractor Transformer
Cheng Zhang, Minnan Luo, Zesheng Yang +3
Transformer architectures have dramatically advanced representation learning and inference in deep models through self-attention mechanisms. In parallel,associative memory (AM) fra…
SpecXMaster Technical Report
Yutang Ge, Yaning Cui, Hanzheng Li +15
Intelligent spectroscopy serves as a pivotal element in AI-driven closed-loop scientific discovery, functioning as the critical bridge between matter structure and artificial intel…
Information-Theoretic Generalization Bounds of Replay-based Continual Learning
Wen Wen, Tieliang Gong, Zeyu Gao +3
Continual learning (CL) has emerged as a dominant paradigm for acquiring knowledge from sequential tasks while avoiding catastrophic forgetting. Although many CL methods have been…