476 citations · 1.3k across the 134 of their papers we have counts for
8 papers · 1 filter
Co-Evolving LLM Evaluators and Policies via DynamicRubric
Beining Wang, Weihang Su, Hongtao Tian +8
Post-training with evaluator feedback on policy-induced samples serves as a major mechanism for improving large language models. As policies improve, these sampled responses become…
Beyond Experience Retrieval: Learning to Generate Utility-Optimized Structured Experience for Frozen LLMs
Xuancheng Li, Haitao Li, Yujia Zhou +2
Large language models (LLMs) are largely static and often redo reasoning or repeat mistakes. Prior experience reuse typically relies on external retrieval, which is similarity-base…
Relative-Based Scaling Law for Neural Language Models
Baoqing Yue, Jinyuan Zhou, Zixi Wei +3
Scaling laws aim to accurately predict model performance across different scales. Existing scaling-law studies almost exclusively rely on cross-entropy as the evaluation metric. Ho…
Hierarchical LoRA MoE for Efficient CTR Model Scaling
Zhichen Zeng, Mengyue Hang, Xiaolong Liu +11
Deep models have driven significant advances in click-through rate (CTR) prediction. While vertical scaling via layer stacking improves model expressiveness, the layer-by-layer seq…
MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systems
Qingyao Ai, Yichen Tang, Changyue Wang +3
Scaling up data, parameters, and test-time computation has been the mainstream methods to improve LLM systems (LLMsys), but their upper bounds are almost reached due to the gradual…
What Scales in Cross-Entropy Scaling Law?
Junxi Yan, Zixi Wei, Qingyao Ai +2
The cross-entropy scaling law has long served as a key tool for guiding the development of large language models. It shows that cross-entropy loss decreases in a predictable power-…
A Survey on Dropout Methods and Experimental Verification in Recommendation
Yangkun Li, Weizhi Ma, Chong Chen +4
Overfitting is a common problem in machine learning, which means the model too closely fits the training data while performing poorly in the test data. Among various methods of cop…
NxtPost: User to Post Recommendations in Facebook Groups
Kaushik Rangadurai, Yiqun Liu, Siddarth Malreddy +4
In this paper, we present NxtPost, a deployed user-to-post content-based sequential recommender system for Facebook Groups. Inspired by recent advances in NLP, we have adapted a Tr…