most citedDisentangling the Causes of Plasticity Loss in Neural Networks

5 citations · 7 across the 5 of their papers we have counts for

collaborators

5 papers

cs.LG2024★ 1 cited

Normalization and effective learning rates in reinforcement learning

Clare Lyle, Zeyu Zheng, Khimya Khetarpal +4

Normalization layers have recently experienced a renaissance in the deep reinforcement learning and continual learning literature, with several works highlighting diverse benefits…

cs.LG2024★ 1 cited

Weight Clipping for Deep Continual and Reinforcement Learning

Mohamed Elsayed, Qingfeng Lan, Clare Lyle +1

Many failures in deep continual and reinforcement learning are associated with increasing magnitudes of the weights, making them hard to change and potentially causing overfitting.…

cs.LG2024

A Unifying Framework for Action-Conditional Self-Predictive Reinforcement Learning

Khimya Khetarpal, Zhaohan Daniel Guo, Bernardo Avila Pires +7

Learning a good representation is a crucial challenge for Reinforcement Learning (RL) agents. Self-predictive learning provides means to jointly learn a latent representation and d…

cs.LG2024★ 5 cited

Disentangling the Causes of Plasticity Loss in Neural Networks

Clare Lyle, Zeyu Zheng, Khimya Khetarpal +4

Underpinning the past decades of work on the design, initialization, and optimization of neural networks is a seemingly innocuous assumption: that the network is trained on a \text…

cs.LG2024

Near-Minimax-Optimal Distributional Reinforcement Learning with a Generative Model

Mark Rowland, Li Kevin Wenliang, Rémi Munos +3

We propose a new algorithm for model-based distributional reinforcement learning (RL), and prove that it is minimax-optimal for approximating return distributions with a generative…