3 papers
cs.LG2026
Optimizer Memory Makes Shuffle Order a First-Order Source of Fine-Tuning Noise
John Sweeney
Shuffle order can be a larger source of fine-tuning noise than a memoryless analysis predicts: fixed-clock optimizer memory makes local equal-multiset contrasts first order in the…
cs.LG2026
The Geometry of Updates: Fisher Alignment at Vocabulary Scale
John Sweeney
Training-free source selection for LLM families with shared vocabularies arises in scientific string domains such as SMILES, protein, and genomic sequences, where candidate corpora…
cs.LG2026
The Geometry of Sequential Learning: Lie-Bracket Prediction of Transfer Order
John Sweeney
Sequential learning is order-dependent: from Pile-style next-token domain adaptation to instruction-SFT and DPO, N candidate sources induce N! possible curricula. We show that the…