6 papers
FOUNDv2: Learning Unified User Quantized Tokenizers for User Representation
Chuan He, Yang Chen, Bin Dou +10
User representation learning serves as a fundamental pillar for personalized services on large-scale web platforms. Despite its importance, conventional continuous embedding method…
TabEmbed: Benchmarking and Learning Generalist Embeddings for Tabular Understanding
Minjie Qiang, Mingming Zhang, Xiaoyi Bao +5
Foundation models have established unified representations for natural language processing, yet this paradigm remains largely unexplored for tabular data. Existing methods face fun…
How Do Decoder-Only LLMs Perceive Users? Rethinking Attention Masking for User Representation Learning
Jiahao Yuan, Yike Xu, Jinyong Wen +8
Decoder-only large language models are increasingly used as behavioral encoders for user representation learning, yet the impact of attention masking on the quality of user embeddi…
Instruction-aware User Embedding via Synergistic Language and Representation Modeling
Ziyi Gao, Yike Xu, Jiahao Yuan +9
User representation modeling has become increasingly crucial for personalized applications, yet existing approaches struggle with generalizability across domains and sensitivity to…
Multi-Grained Preference Enhanced Transformer for Multi-Behavior Sequential Recommendation
Chuan He, Yongchao Liu, Qiang Li +5
Sequential recommendation (SR) aims to predict the next purchasing item according to users' dynamic preference learned from their historical user-item interactions. To improve the…
Estimating Conditional Average Treatment Effects via Sufficient Representation Learning
Pengfei Shi, Wei Zhong, Xinyu Zhang +4
Estimating the conditional average treatment effects (CATE) is very important in causal inference and has a wide range of applications across many fields. In the estimation process…