4 papers · 1 filter
Beyond Fixed Depths and Widths: Optimizing Textual Decoding Tries in LLM-based Generative Recommendation
Jingzhe Liu, Hanbing Wang, Jiliang Tang +4
Generative recommendation (GR) is an increasingly popular paradigm in recommender systems, with a prominent line of work using LLMs as autoregressive backbones to predict the next…
FlexRec: Adapting LLM-based Recommenders for Flexible Needs via Reinforcement Learning
Yijun Pan, Weikang Qiu, Qiyao Ma +4
Modern recommender systems must adapt to dynamic, need-specific objectives for diverse recommendation scenarios, yet most traditional recommenders are optimized for a single static…
Plain Transformers are Surprisingly Powerful Link Predictors
Quang Truong, Yu Song, Donald Loveland +4
Link prediction is a core challenge in graph machine learning, demanding models that capture rich and complex topological dependencies. While Graph Neural Networks (GNNs) are the s…
Threshold Differential Attention for Sink-Free, Ultra-Sparse, and Non-Dispersive Language Modeling
Xingyue Huang, Xueying Ding, Mingxuan Ju +3
Softmax attention struggles with long contexts due to structural limitations: the strict sum-to-one constraint forces attention sinks on irrelevant tokens, and probability mass dis…