1 citations · 1 across the 5 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024★ 1 cited
Remembering Transformer for Continual Learning
Yuwei Sun, Ippei Fujisawa, Arthur Juliani +2
Neural networks encounter the challenge of Catastrophic Forgetting (CF) in continual learning, where new task learning interferes with previously learned knowledge. Existing data f…
cs.LG2023
Associative Transformer
Yuwei Sun, Hideya Ochiai, Zhirong Wu +2
Emerging from the pairwise attention in conventional Transformers, there is a growing interest in sparse attention mechanisms that align more closely with localized, contextual lea…