69 citations · 241 across the 22 of their papers we have counts for
13 papers · 1 filter
LoopFM: Learning frOm HistOrical RePresentations of Foundation Model for Recommendation
Shali Jiang, Hua Zheng, Boyang Liu +40
Knowledge distillation (KD) transfers a single scalar prediction from a large foundation model (FM) to compact vertical models (VMs), suffering from diminishing transfer ratio -- t…
Multi-Objective Bilevel Learning
Zhiyao Zhang, Zhuqing Liu, Xin Zhang +3
As machine learning (ML) applications grow increasingly complex in recent years, modern ML frameworks often need to address multiple potentially conflicting objectives with coupled…
Hierarchical LoRA MoE for Efficient CTR Model Scaling
Zhichen Zeng, Mengyue Hang, Xiaolong Liu +11
Deep models have driven significant advances in click-through rate (CTR) prediction. While vertical scaling via layer stacking improves model expressiveness, the layer-by-layer seq…
CubicML: Automated ML for Large ML Systems Co-design with ML Prediction of Performance
Wei Wen, Quanyu Zhu, Weiwei Chu +2
Scaling up deep learning models has been proven effective to improve intelligence of machine learning (ML) models, especially for industry recommendation models and large language…
Rankitect: Ranking Architecture Search Battling World-class Engineers at Meta Scale
Wei Wen, Kuang-Hung Liu, Igor Fedorov +19
Neural Architecture Search (NAS) has demonstrated its efficacy in computer vision and potential for ranking systems. However, prior work focused on academic problems, which are eva…
CPR: Understanding and Improving Failure Tolerant Training for Deep Learning Recommendation with Partial Recovery
Kiwan Maeng, Shivam Bharuka, Isabel Gao +8
The paper proposes and optimizes a partial recovery training system, CPR, for recommendation models. CPR relaxes the consistency requirement by enabling non-failed nodes to proceed…