9 papers
Exploring the Design Space of Permutation Diffusion LLMs
Zhe Xu, Mingfu Liang, Kavosh Asadi +16
Permutation generation with language models requires both text-conditioned ranking and a global one-to-one assignment between candidates and output positions. We study this problem…
SCOReD: Student-Aware CoT Optimization for Recommendation Distillation
Haz Sameen Shahgir, Yufei Li, Xiaohan Wei +8
Chain-of-thought (CoT) distillation in the recommendation domain is a necessary precursor to RL training, but raw teacher traces are ill-suited to this task. Large teachers approac…
GR2 Technical Report
Yufei Li, Zaiwei Zhang, Mingfu Liang +67
Industrial recommendation systems serve billions of users through a multi-stage funnel -- retrieval, early-stage ranking, and re-ranking -- where the final re-ranking step dispropo…
Learning Evidence Highlighting for Frozen LLMs
Shaoang Li, Yanhang Shi, Yufei Li +10
Large Language Models (LLMs) can reason well, yet often miss decisive evidence when it is buried in long, noisy contexts. We introduce HiLight, an Evidence Emphasis framework that…
GR2: Generative Reasoning Re-ranker
Mingfu Liang, Yufei Li, Jay Xu +20
Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work h…
OpenMic: A Multi-Agent-Based Stand-Up Comedy Generation System
Yuyang Wu, Hanzhong Cao, Jianhao Chen +1
Chinese stand-up comedy generation goes beyond plain text generation, requiring culturally grounded humor, precise timing, stage-performance cues, and implicit multi-step reasoning…
MACE: A Hybrid LLM Serving System with Colocated SLO-aware Continuous Retraining Alignment
Yufei Li, Yu Fu, Yue Dong +1
Large language models (LLMs) deployed on edge servers are increasingly used in latency-sensitive applications such as personalized assistants, recommendation, and content moderatio…
LeMix: Unified Scheduling for LLM Training and Inference on Multi-GPU Systems
Yufei Li, Zexin Li, Yinglun Zhu +1
Modern deployment of large language models (LLMs) frequently involves both inference serving and continuous retraining to stay aligned with evolving data and user feedback. Common…
Dr Genre: Reinforcement Learning from Decoupled LLM Feedback for Generic Text Rewriting
Yufei Li, John Nham, Ganesh Jawahar +7
Generic text rewriting is a prevalent large language model (LLM) application that covers diverse real-world tasks, such as style transfer, fact correction, and email editing. These…