17 papers
Beyond Fixed Depths and Widths: Optimizing Textual Decoding Tries in LLM-based Generative Recommendation
Jingzhe Liu, Hanbing Wang, Jiliang Tang +4
Generative recommendation (GR) is an increasingly popular paradigm in recommender systems, with a prominent line of work using LLMs as autoregressive backbones to predict the next…
Threshold Differential Attention for Sink-Free, Ultra-Sparse, and Non-Dispersive Language Modeling
Xingyue Huang, Xueying Ding, Mingxuan Ju +3
Softmax attention struggles with long contexts due to structural limitations: the strict sum-to-one constraint forces attention sinks on irrelevant tokens, and probability mass dis…
Understanding Generative Recommendation with Semantic IDs from a Model-scaling View
Jingzhe Liu, Liam Collins, Jiliang Tang +3
Recent advancements in generative models have allowed the emergence of a promising paradigm for recommender systems (RS), known as Generative Recommendation (GR), which tries to un…
Plain Transformers are Surprisingly Powerful Link Predictors
Quang Truong, Yu Song, Donald Loveland +4
Link prediction is a core challenge in graph machine learning, demanding models that capture rich and complex topological dependencies. While Graph Neural Networks (GNNs) are the s…
Breaking Information Cocoons: A Hyperbolic Framework for Balancing Exploration and Exploitation in Recommender Systems
Qiyao Ma, Menglin Yang, Mingxuan Ju +3
Modern recommender systems often create information cocoons, restricting users' exposure to diverse content. The central challenge is to balance content exploration and exploitatio…
Sequential Data Augmentation for Generative Recommendation
Geon Lee, Bhuvesh Kumar, Clark Mingxuan Ju +4
Generative recommendation plays a crucial role in personalized systems, predicting users' future interactions from their historical behavior sequences. A critical yet underexplored…