most citedLearning Curves for Continual Learning in Neural Networks: Self-Knowledge Transfer and Forgetting

2 citations · 3 across the 4 of their papers we have counts for

collaborators
Showing stat.MLShow all

2 papers · 1 filter

stat.ML2024

Self-attention Networks Localize When QK-eigenspectrum Concentrates

Han Bao, Ryuichiro Hataya, Ryo Karakida

The self-attention mechanism prevails in modern machine learning. It has an interesting functionality of adaptively selecting tokens from an input sequence by modulating the degree…

stat.ML2021★ 2 cited

Learning Curves for Continual Learning in Neural Networks: Self-Knowledge Transfer and Forgetting

Ryo Karakida, Shotaro Akaho

Sequential training from task to task is becoming one of the major objects in deep learning applications such as continual learning and transfer learning. Nevertheless, it remains…