6 papers · 1 filter
Diffusion-GR2: Diffusion Generative Reasoning Re-ranker
Zhuoxuan Zhang, Kangqi Ni, Yuhang Chen +12
Generative reasoning re-rankers achieve strong recommendation accuracy by emitting a chain-of-thought before re-ordering a candidate list, but they are slow at inference: an autore…
SCOReD: Student-Aware CoT Optimization for Recommendation Distillation
Haz Sameen Shahgir, Yufei Li, Xiaohan Wei +8
Chain-of-thought (CoT) distillation in the recommendation domain is a necessary precursor to RL training, but raw teacher traces are ill-suited to this task. Large teachers approac…
End-to-End Dynamic Sparsity for Resource-Adaptive LLM Inference
Yuhang Chen, Jinhao Duan, Ruichen Zhang +11
Large Language Models (LLMs) inference is typically deployed under a static resource assumption, where models execute a fixed computational graph regardless of the runtime environm…
Bifocal Diffusion Language Models: Asymmetric Bidirectional Context for Parallel Generation
Yuhang Chen, Xianfeng Wu, Jinhao Duan +11
Discrete diffusion language models (dLLMs) recover masked tokens in parallel, offering significant speedups over autoregressive (AR) generation. However, such promising frameworks…
Efficient Retrieval Scaling with Hierarchical Indexing for Large Scale Recommendation
Dongqi Fu, Kaushik Rangadurai, Haiyu Lu +13
The increase in data volume, computational resources, and model parameters during training has led to the development of numerous large-scale industrial retrieval models for recomm…
Hierarchical Structured Neural Network: Efficient Retrieval Scaling for Large Scale Recommendation
Kaushik Rangadurai, Siyang Yuan, Minhui Huang +12
Retrieval, the initial stage of a recommendation system, is tasked with down-selecting items from a pool of tens of millions of candidates to a few thousands. Embedding Based Retri…