2 papers
cs.CL2026
Which Models Are Our Models Built On? Auditing Invisible Dependencies in Modern LLMs
Sanjay Adhikesaven, Haoxiang Sun, Sewon Min
Modern LLM training pipelines increasingly rely on other models to generate data, filter corpora, judge outputs, and guide development decisions. These dependencies are recursive:…
cs.LG2026
Train Separately, Merge Together: Modular Post-Training with Mixture-of-Experts
Jacob Morrison, Sanjay Adhikesaven, Akshita Bhagia +3
Extending a fully post-trained language model with new domain capabilities is fundamentally limited by monolithic training paradigms: retraining from scratch is expensive and scale…