3 citations · 3 across the 5 of their papers we have counts for
6 papers
Transferable conditional brain charts link cortico-subcortical structure to Alzheimer's disease progression
Nitin Sharma, Sicheng Dai, Francesco A. Mallus +29
Normative models chart how brain measures vary across the lifespan, expressing each individual as a deviation from a healthy reference. However, most regional models of cortical th…
Time-Incremental Continued Pretraining of LLMs: Knowledge Updates Without Catastrophic Forgetting
Fırat Öncel, Salman Hussain Ali, Mirco Ravanelli +2
Large language models (LLMs) drift out of date the moment their pretraining ends, yet retraining from scratch is prohibitively expensive. Continued pretraining (CPT) is the natural…
Optimal Control of Probabilistic Dynamics Models via Mean Hamiltonian Minimization
David Leeftink, Çağatay Yıldız, Steffen Ridderbusch +2
Without exact knowledge of the true system dynamics, optimal control of non-linear continuous-time systems requires careful treatment under epistemic uncertainty. In this work, we…
Adaptation Odyssey in LLMs: Why Does Additional Pretraining Sometimes Fail to Improve?
Fırat Öncel, Matthias Bethge, Beyza Ermis +3
In the last decade, the generalization and adaptation abilities of deep learning models were typically evaluated on fixed training and test distributions. Contrary to traditional d…
Identifying latent state transition in non-linear dynamical systems
Çağlar Hızlı, Çağatay Yıldız, Matthias Bethge +2
This work aims to improve generalization and interpretability of dynamical systems by recovering the underlying lower-dimensional latent states and their time evolutions. Previous…
Investigating Continual Pretraining in Large Language Models: Insights and Implications
Çağatay Yıldız, Nishaanth Kanna Ravichandran, Nitin Sharma +2
Continual learning (CL) in large language models (LLMs) is an evolving domain that focuses on developing efficient and sustainable training strategies to adapt models to emerging k…