35 citations · 35 across the 4 of their papers we have counts for
3 papers · 1 filter
Amortizing Sequential Experimental Design in Reasoning LLMs
Anita Kriz, Antonin Berthon, Nicolás Astorga +1
Despite their extensive pretraining knowledge and strong reasoning capabilities, large language models (LLMs) struggle to adaptively gather information in experimental design tasks…
On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics
Julianna Piskorz, Antonin Berthon, Mihaela van der Schaar
On-policy learning has been argued to reduce catastrophic forgetting, produce sparser parameter updates, and improve generalisation. However, existing comparisons between supervise…
Skill Neologisms: Towards Skill-based Continual Learning
Antonin Berthon, Nicolas Astorga, Mihaela van der Schaar
Modern LLMs show mastery over an ever-growing range of skills, as well as the ability to compose them flexibly. However, extending model capabilities to new skills in a scalable ma…