4 papers
ProtStructQA: A Denotation Threshold in Protein Structural Reasoning
Aravind Mandiga, Guoming Li, Jin Lu +3
Protein-language systems are often evaluated by whether they generate plausible biological text, but a structural question has a sharper semantics: it denotes a measurement in a 3D…
Expand More, Shrink Less: Shaping Effective-Rank Dynamics for Dense Scaling in Recommendation
Guoming Li, Shangyu Zhang, Junwei Pan +7
Scaling recommendation models is a central challenge in recommender systems. Recently, RankMixer has emerged as an effective solution, operating on a unified token representation a…
End-to-End On-Device Quantization-Aware Training for LLMs at Inference Cost
Qitao Tan, Xiaoying Song, Jin Lu +9
Quantization is an effective technique to reduce the deployment cost of large language models (LLMs), and post-training quantization (PTQ) has been widely studied due to its effici…
Rethinking the Potential of Layer Freezing for Efficient DNN Training
Chence Yang, Ci Zhang, Lei Lu +11
With the growing size of deep neural networks and datasets, the computational costs of training have significantly increased. The layer-freezing technique has recently attracted gr…