134 citations · 445 across the 29 of their papers we have counts for
30 papers
Token Factory: Efficiently Integrating Diverse Signals into Large Recommendation Models
Xilun Chen, Shao-Chuan Wang, Baykal Cakici +6
Large Recommendation Models (LRMs) have demonstrated promising capabilities in industry-scale recommendation tasks. However, holistically integrating traditional signals into these…
Tokens are All You Need: Dual-purpose Semantic IDs for Achieving LLM-Level I/O Efficiency in recommendation systems
Baolei Li, Yiping Yuan, Yilin Zheng +6
Large-scale recommendation systems face "Memory Wall" bottlenecks due to massive, dense embedding tables. While generative retrieval uses discrete tokens for IDs, high-dimensional…
TokenMinds: Pretrained User Tokens and Embeddings for User Understanding in Large Recommender Systems
Qingyun Liu, Bo Yan, Yang Liu +15
User modeling in industrial recommender systems typically produces dense embeddings, which suffer from representational constraints inherent to fixed-dimensional vectors. An emergi…
ORBIT: Preserving Foundational Language Capabilities in GenRetrieval via Origin-Regulated Merging
Neha Verma, Nikhil Mehta, Shao-Chuan Wang +7
Despite the rapid advancements in large language model (LLM) development, fine-tuning them for specific tasks often results in the catastrophic forgetting of their general, languag…
Vectorizing the Trie: Efficient Constrained Decoding for LLM-based Generative Retrieval on Accelerators
Zhengyang Su, Isay Katsman, Yueqi Wang +10
Generative retrieval has emerged as a powerful paradigm for LLM-based recommendation. However, industrial recommender systems often benefit from restricting the output space to a c…
PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendations
Ruining He, Lukasz Heldt, Lichan Hong +20
Large Language Models (LLMs) pose a new paradigm of modeling and computation for information tasks. Recommendation systems are a critical application domain poised to benefit signi…
STAR: A Simple Training-free Approach for Recommendations using Large Language Models
Dong-Ho Lee, Adam Kraft, Long Jin +5
Recent progress in large language models (LLMs) offers promising new approaches for recommendation system tasks. While the current state-of-the-art methods rely on fine-tuning LLMs…
Leveraging LLM Reasoning Enhances Personalized Recommender Systems
Alicia Y. Tsai, Adam Kraft, Long Jin +7
Recent advancements have showcased the potential of Large Language Models (LLMs) in executing reasoning tasks, particularly facilitated by Chain-of-Thought (CoT) prompting. While t…
Aligning Large Language Models with Recommendation Knowledge
Yuwei Cao, Nikhil Mehta, Xinyang Yi +5
Large language models (LLMs) have recently been used as backbones for recommender systems. However, their performance often lags behind conventional methods in standard tasks like…
Density Weighting for Multi-Interest Personalized Recommendation
Nikhil Mehta, Anima Singh, Xinyang Yi +3
Using multiple user representations (MUR) to model user behavior instead of a single user representation (SUR) has been shown to improve personalization in recommendation systems.…
Online Matching: A Real-time Bandit System for Large-scale Recommendations
Xinyang Yi, Shao-Chuan Wang, Ruining He +6
The last decade has witnessed many successes of deep learning-based models for industry-scale recommender systems. These models are typically trained offline in a batch manner. Whi…
Better Generalization with Semantic IDs: A Case Study in Ranking for Recommendations
Anima Singh, Trung Vu, Nikhil Mehta +9
Randomly-hashed item ids are used ubiquitously in recommendation models. However, the learned representations from random hashing prevents generalization across similar items, caus…
Improving Training Stability for Multitask Ranking Models in Recommender Systems
Jiaxi Tang, Yoel Drori, Daryl Chang +6
Recommender systems play an important role in many content platforms. While most recommendation research is dedicated to designing better models to improve user experience, we foun…
Empowering Long-tail Item Recommendation through Cross Decoupling Network (CDN)
Yin Zhang, Ruoxi Wang, Tiansheng Yao +5
Industry recommender systems usually suffer from highly-skewed long-tail item distributions where a small fraction of the items receives most of the user feedback. This skew hurts…
Reward Shaping for User Satisfaction in a REINFORCE Recommender
Konstantina Christakopoulou, Can Xu, Sai Zhang +10
How might we design Reinforcement Learning (RL)-based recommenders that encourage aligning user trajectories with the underlying user satisfaction? Three research questions are key…
Improving Multi-Task Generalization via Regularizing Spurious Correlation
Ziniu Hu, Zhe Zhao, Xinyang Yi +4
Multi-Task Learning (MTL) is a powerful learning paradigm to improve generalization performance via knowledge sharing. However, existing studies find that MTL could sometimes hurt…
A Model of Two Tales: Dual Transfer Learning Framework for Improved Long-tail Item Recommendation
Yin Zhang, Derek Zhiyuan Cheng, Tiansheng Yao +3
Highly skewed long-tail item distribution is very common in recommendation systems. It significantly hurts model performance on tail items. To improve tail-item recommendation, we…
Learning to Embed Categorical Features without Embedding Tables for Recommendation
Wang-Cheng Kang, Derek Zhiyuan Cheng, Tiansheng Yao +4
Embedding learning of categorical features (e.g. user/item IDs) is at the core of various recommendation models including matrix factorization and neural collaborative filtering. T…
Self-supervised Learning for Large-scale Item Recommendations
Tiansheng Yao, Xinyang Yi, Derek Zhiyuan Cheng +8
Large scale recommender models find most relevant items from huge catalogs, and they play a critical role in modern search and recommendation systems. To model the input space with…
Learning-to-Rank with Partitioned Preference: Fast Estimation for the Plackett-Luce Model
Jiaqi Ma, Xinyang Yi, Weijing Tang +4
We investigate the Plackett-Luce (PL) model based listwise learning-to-rank (LTR) on data with partitioned preference, where a set of items are sliced into ordered and disjoint par…
Learning Multi-granular Quantized Embeddings for Large-Vocab Categorical Features in Recommender Systems
Wang-Cheng Kang, Derek Zhiyuan Cheng, Ting Chen +4
Recommender system models often represent various sparse features like users, items, and categorical features via embeddings. A standard approach is to map each unique feature valu…
More Supervision, Less Computation: Statistical-Computational Tradeoffs in Weakly Supervised Learning
Xinyang Yi, Zhaoran Wang, Zhuoran Yang +2
We consider the weakly supervised binary classification problem where the labels are randomly flipped with probability . Although there exist numerous algorithms for this pro…
Efficient Training on Very Large Corpora via Gramian Estimation
Walid Krichene, Nicolas Mayoraz, Steffen Rendle +5
We study the problem of learning similarity functions over very large corpora using neural network embedding models. These models are typically trained using SGD with sampling of r…
Solving a Mixture of Many Random Linear Equations by Tensor Decomposition and Alternating Minimization
Xinyang Yi, Constantine Caramanis, Sujay Sanghavi
We consider the problem of solving mixed random linear equations with components. This is the noiseless setting of mixed linear regression. The goal is to estimate multiple lin…