Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Can Muon Fine-tune Adam-Pretrained Models?
Xingyu Qu, Peigeng Huang, Samuel Horvath
Muon has emerged as an efficient alternative to Adam for pretraining, yet remains underused for fine-tuning. A key obstacle is that most open models are pretrained with Adam, and n…
cs.LG2026
HAServe: Horizon-Aware Scheduling and Memory Co-Design for Efficient LLM Serving
Xingyu Qu, Tianhao Lin, Yiqi Li +2
Online large language model (LLM) services process requests that share context but differ in prefix structure and arrival timing. Finite capacity couples request admission and key-…
cs.LG2024
Vanishing Feature: Diagnosing Model Merging and Beyond
Xingyu Qu, Samuel Horvath
Model merging offers an efficient way to combine pre-trained neural networks but often suffers from inconsistent performance, especially when merging models with different initiali…