1 citations · 1 across the 3 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Priced Guidance: Can Language Models Generate Future Research Ideas?
Kaiyue Wen, Tengyu Ma, Percy Liang
We evaluate language models' capability to generate novel research ideas through the lens of compression. We aim to lower-bound the potentially tiny probability that a language mod…
cs.LG2026
Fantastic Pretraining Optimizers and Where to Find Them II: Hyperball Optimization
Kaiyue Wen, Xingyu Dang, Kaifeng Lyu +2
Matrix based optimizers such as Muon can substantially speed up language model pretraining, but their gains over AdamW are observed to shrink as model size and data scale grow when…