4 papers
TurboGR: An Accelerated Training System for Large-Scale Generative Recommendation
Huichao Chai, Zhixin Wu, Xuemiao Li +8
Generative recommendation (GR) has emerged as a promising paradigm that replaces fragmented, scenario-specific architectures with unified Transformer-based models, exhibiting scali…
RelayGR: Scaling Long-Sequence Generative Recommendation via Cross-Stage Relay-Race Inference
Jiarui Wang, Huichao Chai, Yuanhang Zhang +38
Real-time recommender systems execute multi-stage cascades (retrieval, pre-processing, fine-grained ranking) under strict tail-latency SLOs, leaving only tens of milliseconds for r…
P/D-Device: Disaggregated Large Language Model between Cloud and Devices
Yibo Jin, Yixu Xu, Yue Chen +27
Serving disaggregated large language models has been widely adopted in industrial practice for enhanced performance. However, too many tokens generated in decoding phase, i.e., occ…
Subspecialty-Specific Foundation Model for Intelligent Gastrointestinal Pathology
Lianghui Zhu, Xitong Ling, Minxi Ouyang +24
Gastrointestinal (GI) diseases represent a clinically significant burden, necessitating precise diagnostic approaches to optimize patient outcomes. Conventional histopathological d…