437 citations · 721 across the 14 of their papers we have counts for
15 papers
How to Train Data-Efficient LLMs
Noveen Sachdeva, Benjamin Coleman, Wang-Cheng Kang +6
The training of large language models (LLMs) is expensive. In this paper, we study data-efficient approaches for pre-training LLMs, i.e., techniques that aim to optimize the Pareto…
Farzi Data: Autoregressive Data Distillation
Noveen Sachdeva, Zexue He, Wang-Cheng Kang +3
We study data distillation for auto-regressive machine learning tasks, where the input and output have a strict left-to-right causal structure. More specifically, we propose Farzi,…
Do LLMs Understand User Preferences? Evaluating LLMs On User Rating Prediction
Wang-Cheng Kang, Jianmo Ni, Nikhil Mehta +4
Large Language Models (LLMs) have demonstrated exceptional capabilities in generalizing to new tasks in a zero-shot or few-shot manner. However, the extent to which LLMs can compre…
Unified Embedding: Battle-Tested Feature Representations for Web-Scale ML Systems
Benjamin Coleman, Wang-Cheng Kang, Matthew Fahrbach +4
Learning high-quality feature embeddings efficiently and effectively is critical for the performance of web-scale machine learning systems. A typical model ingests hundreds of feat…
Learning to Embed Categorical Features without Embedding Tables for Recommendation
Wang-Cheng Kang, Derek Zhiyuan Cheng, Tiansheng Yao +4
Embedding learning of categorical features (e.g. user/item IDs) is at the core of various recommendation models including matrix factorization and neural collaborative filtering. T…
Learning Multi-granular Quantized Embeddings for Large-Vocab Categorical Features in Recommender Systems
Wang-Cheng Kang, Derek Zhiyuan Cheng, Ting Chen +4
Recommender system models often represent various sparse features like users, items, and categorical features via embeddings. A standard approach is to map each unique feature valu…
Candidate Generation with Binary Codes for Large-Scale Top-N Recommendation
Wang-Cheng Kang, Julian McAuley
Generating the Top-N recommendations from a large corpus is computationally expensive to perform at scale. Candidate generation and re-ranking based approaches are often adopted in…
CosRec: 2D Convolutional Neural Networks for Sequential Recommendation
An Yan, Shuo Cheng, Wang-Cheng Kang +2
Sequential patterns play an important role in building modern recommender systems. To this end, several recommender systems have been built on top of Markov Chains and Recurrent Mo…
Complete the Look: Scene-based Complementary Product Recommendation
Wang-Cheng Kang, Eric Kim, Jure Leskovec +2
Modeling fashion compatibility is challenging due to its complexity and subjectivity. Existing work focuses on predicting compatibility between product images (e.g. an image contai…
Learning Consumer and Producer Embeddings for User-Generated Content Recommendation
Wang-Cheng Kang, Julian McAuley
User-Generated Content (UGC) is at the core of web applications where users can both produce and consume content. This differs from traditional e-Commerce domains where content pro…
Recommendation Through Mixtures of Heterogeneous Item Relationships
Wang-Cheng Kang, Mengting Wan, Julian McAuley
Recommender Systems have proliferated as general-purpose approaches to model a wide variety of consumer interaction data. Specific instances make use of signals ranging from user f…
Self-Attentive Sequential Recommendation
Wang-Cheng Kang, Julian McAuley
Sequential dynamics are a key feature of many modern recommender systems, which seek to capture the `context' of users' activities on the basis of actions they have performed recen…
Visually-Aware Fashion Recommendation and Design with Generative Image Models
Wang-Cheng Kang, Chen Fang, Zhaowen Wang +1
Building effective recommender systems for domains like fashion is challenging due to the high level of subjectivity and the semantic complexity of the features involved (i.e., fas…
Translation-based Recommendation
Ruining He, Wang-Cheng Kang, Julian McAuley
Modeling the complex interactions between users and items as well as amongst items themselves is at the core of designing successful recommender systems. One classical setting is p…
Feature Learning based Deep Supervised Hashing with Pairwise Labels
Wu-Jun Li, Sheng Wang, Wang-Cheng Kang
Recent years have witnessed wide application of hashing for large-scale image retrieval. However, most existing hashing methods are based on hand-crafted features which might not b…