567 citations · 646 across the 17 of their papers we have counts for
17 papers
Deep-learning Causal Retrieval Optimization for Efficient e-commerce Distribution in Pinterest
Junpeng Hou, XianXing Zhang, Sai Xiao +6
Pinterest is where people turn inspiration into action as users browse ideas, then take steps toward realization, often by discovering shoppable content. To support this journey, w…
PACEvolve: Enabling Progress-Aware Consistent Evolution
Minghao Yan, Bo Peng, Benjamin Coleman +13
Self-evolving agents powered by Large Language Models (LLMs) have emerged as a promising direction across diverse domains, including code optimization and scientific discovery, yet…
Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory
Tianxin Wei, Noveen Sachdeva, Benjamin Coleman +12
Statefulness is essential for large language model (LLM) agents to perform long-term planning and problem-solving. This makes memory a critical component, yet its management and ev…
ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendation
Yupeng Hou, Jianmo Ni, Zhankui He +5
Generative recommendation (GR) is an emerging paradigm where user actions are tokenized into discrete token patterns and autoregressively generated as predictions. However, existin…
How to Train Data-Efficient LLMs
Noveen Sachdeva, Benjamin Coleman, Wang-Cheng Kang +6
The training of large language models (LLMs) is expensive. In this paper, we study data-efficient approaches for pre-training LLMs, i.e., techniques that aim to optimize the Pareto…
Farzi Data: Autoregressive Data Distillation
Noveen Sachdeva, Zexue He, Wang-Cheng Kang +3
We study data distillation for auto-regressive machine learning tasks, where the input and output have a strict left-to-right causal structure. More specifically, we propose Farzi,…
HyperFormer: Learning Expressive Sparse Feature Representations via Hypergraph Transformer
Kaize Ding, Albert Jiongqian Liang, Bryan Perrozi +6
Learning expressive representations for high-dimensional yet sparse features has been a longstanding problem in information retrieval. Though recent deep learning methods can parti…
Do LLMs Understand User Preferences? Evaluating LLMs On User Rating Prediction
Wang-Cheng Kang, Jianmo Ni, Nikhil Mehta +4
Large Language Models (LLMs) have demonstrated exceptional capabilities in generalizing to new tasks in a zero-shot or few-shot manner. However, the extent to which LLMs can compre…
Unified Embedding: Battle-Tested Feature Representations for Web-Scale ML Systems
Benjamin Coleman, Wang-Cheng Kang, Matthew Fahrbach +4
Learning high-quality feature embeddings efficiently and effectively is critical for the performance of web-scale machine learning systems. A typical model ingests hundreds of feat…
Empowering Long-tail Item Recommendation through Cross Decoupling Network (CDN)
Yin Zhang, Ruoxi Wang, Tiansheng Yao +5
Industry recommender systems usually suffer from highly-skewed long-tail item distributions where a small fraction of the items receives most of the user feedback. This skew hurts…
A Model of Two Tales: Dual Transfer Learning Framework for Improved Long-tail Item Recommendation
Yin Zhang, Derek Zhiyuan Cheng, Tiansheng Yao +3
Highly skewed long-tail item distribution is very common in recommendation systems. It significantly hurts model performance on tail items. To improve tail-item recommendation, we…
Learning to Embed Categorical Features without Embedding Tables for Recommendation
Wang-Cheng Kang, Derek Zhiyuan Cheng, Tiansheng Yao +4
Embedding learning of categorical features (e.g. user/item IDs) is at the core of various recommendation models including matrix factorization and neural collaborative filtering. T…
Beyond Point Estimate: Inferring Ensemble Prediction Variation from Neuron Activation Strength in Recommender Systems
Zhe Chen, Yuyan Wang, Dong Lin +4
Despite deep neural network (DNN)'s impressive prediction performance in various domains, it is well known now that a set of DNN models trained with the same model specification an…
DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systems
Ruoxi Wang, Rakesh Shivanna, Derek Z. Cheng +4
Learning effective feature crosses is the key behind building recommender systems. However, the sparse and large feature space requires exhaustive search to identify effective cros…
Content-based Music Similarity with Triplet Networks
Joseph Cleveland, Derek Cheng, Michael Zhou +2
We explore the feasibility of using triplet neural networks to embed songs based on content-based music similarity. Our network is trained using triplets of songs such that two son…
Self-supervised Learning for Large-scale Item Recommendations
Tiansheng Yao, Xinyang Yi, Derek Zhiyuan Cheng +8
Large scale recommender models find most relevant items from huge catalogs, and they play a critical role in modern search and recommendation systems. To model the input space with…
Learning Multi-granular Quantized Embeddings for Large-Vocab Categorical Features in Recommender Systems
Wang-Cheng Kang, Derek Zhiyuan Cheng, Ting Chen +4
Recommender system models often represent various sparse features like users, items, and categorical features via embeddings. A standard approach is to map each unique feature valu…