Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Learning to Remember, Learn, and Forget in Attention-Based Models
Djohan Bonnet, Jamie Lohoff, Jan Finkbeiner +2
In-Context Learning (ICL) in transformers acts as an online associative memory and is believed to underpin their high performance on complex sequence processing tasks. However, in…
cs.LG2026
Active Continual Learning with Metaplastic Binary Bayesian Neural Networks
Kellian Cottart, Théo Ballet, Djohan Bonnet +1
Always-on edge systems must keep learning as conditions change under tight compute budgets and must detect unreliable predictions. Bayesian binary neural networks are attractive in…
cs.LG2025
Bayesian continual learning and forgetting in neural networks
Djohan Bonnet, Kellian Cottart, Tifenn Hirtzlin +4
Biological synapses effortlessly balance memory retention and flexibility, yet artificial neural networks still struggle with the extremes of catastrophic forgetting and catastroph…