2 citations · 3 across the 7 of their papers we have counts for
6 papers · 1 filter
Position: the Stochastic Parrot in the Coal Mine. Model Collapse is a Threat to Low-Resource Communities
Devon Jarvis, Richard Klein, Benjamin Rosman +2
Model collapse, the degradation in performance that arises when generative models are trained on the outputs of prior models, is an increasing concern as artificially generated con…
Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks
Devon Jarvis, Richard Klein, Benjamin Rosman +1
In spite of finite dimension ReLU neural networks being a consistent factor behind recent deep learning successes, a theory of feature learning in these models remains elusive. Cur…
Revisiting the Role of Relearning in Semantic Dementia
Devon Jarvis, Verena Klar, Richard Klein +2
Patients with semantic dementia (SD) present with remarkably consistent atrophy of neurons in the anterior temporal lobe and behavioural impairments, such as graded loss of categor…
On The Specialization of Neural Modules
Devon Jarvis, Richard Klein, Benjamin Rosman +1
A number of machine learning models have been proposed with the goal of achieving systematic generalization: the ability to reason about new situations by combining aspects of prev…
Accounting for the Sequential Nature of States to Learn Features for Reinforcement Learning
Nathan Michlo, Devon Jarvis, Richard Klein +1
In this work, we investigate the properties of data that cause popular representation learning approaches to fail. In particular, we find that in environments where states do not s…
Skill Machines: Temporal Logic Skill Composition in Reinforcement Learning
Geraud Nangue Tasse, Devon Jarvis, Steven James +1
It is desirable for an agent to be able to solve a rich variety of problems that can be specified through language in the same environment. A popular approach towards obtaining suc…