Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
AMO: Adaptive Muon Orthogonalization
Xinlin Zhuang, Panyi Ouyang, Yichen Li +7
Muon has recently emerged as a competitive alternative to AdamW for large-scale pre-training, with orthogonalization via Newton-Schulz (NS) iterations as its core operation. Existi…
cs.LG2025
CHIPS: Efficient CLIP Adaptation via Curvature-aware Hybrid Influence-based Data Selection
Xinlin Zhuang, Yichen Li, Xiwei Liu +11
Adapting CLIP to vertical domains is typically approached by novel fine-tuning strategies or by continual pre-training (CPT) on large domain-specific datasets. Yet, data itself rem…