2 papers
cs.LG2026
What Scales in Cross-Entropy Scaling Law?
Junxi Yan, Zixi Wei, Qingyao Ai +2
The cross-entropy scaling law has long served as a key tool for guiding the development of large language models. It shows that cross-entropy loss decreases in a predictable power-…
cs.CL2025
Parametric Retrieval Augmented Generation
Weihang Su, Yichen Tang, Qingyao Ai +6
Retrieval-augmented generation (RAG) techniques have emerged as a promising solution to enhance the reliability of large language models (LLMs) by addressing issues like hallucinat…