Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Fast and Accurate Probing of In-Training LLMs' Downstream Performances
Zhichen Liu, Tianle Lun, Zhibin Wen +7
The paradigm of scaling Large Language Models (LLMs) in both parameter size and test time has pushed the boundaries of AI capabilities, but at the cost of making the traditional ge…
cs.LG2026
On the Spectral Flattening of Quantized Embeddings
Junlin Huang, Wenyi Fang, Zhenheng Tang +5
Training Large Language Models (LLMs) at ultra-low precision is critically impeded by instability rooted in the conflict between discrete quantization constraints and the intrinsic…