7 papers
Towards a Densing Law for User Representation Learning at Billion-Scale Capacity
Bin Dou, Junru Zhang, Zhaoyi Yuan +6
User representation learning in real-world industrial scenarios is commonly scaled by increasing user amount, behavioral sequence length and model size. However, existing methods f…
TabEmbed: Benchmarking and Learning Generalist Embeddings for Tabular Understanding
Minjie Qiang, Mingming Zhang, Xiaoyi Bao +5
Foundation models have established unified representations for natural language processing, yet this paradigm remains largely unexplored for tabular data. Existing methods face fun…
Query as Anchor: Scenario-Adaptive User Representation via Large Language Model
Jiahao Yuan, Yike Xu, Jinyong Wen +9
Industrial-scale user representation learning requires balancing robust universality with acute task-sensitivity. However, existing paradigms primarily yield static, task-agnostic…
How Do Decoder-Only LLMs Perceive Users? Rethinking Attention Masking for User Representation Learning
Jiahao Yuan, Yike Xu, Jinyong Wen +8
Decoder-only large language models are increasingly used as behavioral encoders for user representation learning, yet the impact of attention masking on the quality of user embeddi…
Instruction-aware User Embedding via Synergistic Language and Representation Modeling
Ziyi Gao, Yike Xu, Jiahao Yuan +9
User representation modeling has become increasingly crucial for personalized applications, yet existing approaches struggle with generalizability across domains and sensitivity to…
FOUNDv2: Learning Unified User Quantized Tokenizers for User Representation
Chuan He, Yang Chen, Bin Dou +10
User representation learning serves as a fundamental pillar for personalized services on large-scale web platforms. Despite its importance, conventional continuous embedding method…
Transferable and Forecastable User Targeting Foundation Model
Bin Dou, Baokun Wang, Yun Zhu +11
User targeting, the process of selecting targeted users from a pool of candidates for non-expert marketers, has garnered substantial attention with the advancements in digital mark…