5 papers
Collaborative Memory Augmentation for Generative Recommendation
Enze Liu, Zhen Tian, Wayne Xin Zhao
Generative Recommendation (GR) has exhibited great potential by modeling item transitions as a sequence-to-sequence task. Despite the success of GR, existing frameworks primarily f…
Dual-Stream MLP is All You Need for CTR Prediction
Kesha Ou, Zhen Tian, Wayne Xin Zhao +3
Click-through rate (CTR) prediction holds a pivotal role in online advertising and recommendation systems, where even small improvements can significantly boost revenue. Existing r…
GenCI: Generative Modeling of User Interest Shift via Cohort-based Intent Learning for CTR Prediction
Kesha Ou, Zhen Tian, Wayne Xin Zhao +2
Click-through rate (CTR) prediction plays a pivotal role in online advertising and recommender systems. Despite notable progress in modeling user preferences from historical behavi…
Irrational Complex Rotations Empower Low-bit Optimizers
Zhen Tian, Wayne Xin Zhao, Ji-Rong Wen
In this paper, we propose a novel optimizer state compression algorithm, namely -Quant, which leverages the properties of irrational numbers (e.g., ) for memory-efficient t…
Exploring Context Window of Large Language Models via Decomposed Positional Vectors
Zican Dong, Junyi Li, Xin Men +5
Transformer-based large language models (LLMs) typically have a limited context window, resulting in significant performance degradation when processing text beyond the length of t…