12 papers
DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning
Qihang Cao, Haoyuan Li, Zihan Guo +8
Achieving general spatial intelligence requires a unified understanding of both static 3D and dynamic 4D. However, we find that existing models struggle to excel at both: 3D post-t…
Probabilistic Residual Learning for Online Recommendations
Wenyuan Wang, Yusong Zhao, Zihao Xu +11
Modern recommender systems are typically based on deep learning (DL) models, where a dense encoder learns representations of users and items. As a result, these systems often suffe…
ExpWeaver: LLM Agents Learn from Experience via Latent RAG
Tao Feng, Tianyang Luo, Jingjun Xu +5
Experience learning has achieved promising results in enhancing LLM agent planning and reasoning by integrating past interactions as reusable knowledge. However, existing methods r…
ExpHarness: Model-Agnostic Experience Learning through a Trainable Harness
Tao Feng, Chongrui Ye, Fangxu Yu +11
Large language model (LLM) agents increasingly operate within a harness, the scaffolding that determines what enters the executor's context, yet the experience they accumulate acro…
LRanker: LLM Ranker for Massive Candidates
Tao Feng, Zijie Lei, Zhigang Hua +4
Large language models (LLMs) have recently shown strong potential for ranking by capturing semantic relevance and adapting across diverse domains, yet existing methods remain const…
MemReward: Graph-Based Experience Memory for LLM Reward Prediction with Limited Labels
Tianyang Luo, Tao Feng, Zhigang Hua +4
Reinforcement learning has emerged as a powerful paradigm for improving large language model (LLM) reasoning, where rollouts are sampled from the policy and reward signals computed…
UniRec: Unified Multimodal Encoding for LLM-Based Recommendations
Zijie Lei, Tao Feng, Zhigang Hua +5
Large language models have recently shown promise for multimodal recommendation, particularly with text and image inputs. Yet real-world recommendation signals extend far beyond th…
CoFiRec: Coarse-to-Fine Tokenization for Generative Recommendation
Tianxin Wei, Xuying Ning, Xuxing Chen +6
In web environments, user preferences are often refined progressively as users move from browsing broad categories to exploring specific items. However, existing generative recomme…
R1-Ranker: Teaching LLM Rankers to Reason
Tao Feng, Zhigang Hua, Zijie Lei +4
Large language models (LLMs) have recently shown strong reasoning abilities in domains like mathematics, coding, and scientific problem-solving, yet their potential for ranking tas…
Unified Semantic and ID Representation Learning for Deep Recommenders
Guanyu Lin, Zhigang Hua, Tao Feng +3
Effective recommendation is crucial for large-scale online platforms. Traditional recommendation systems primarily rely on ID tokens to uniquely identify items, which can effective…
Session-Level Dynamic Ad Load Optimization using Offline Robust Reinforcement Learning
Tao Liu, Qi Xu, Wei Shi +2
Session-level dynamic ad load optimization aims to personalize the density and types of delivered advertisements in real time during a user's online session by dynamically balancin…
Ads Supply Personalization via Doubly Robust Learning
Wei Shi, Chen Fu, Qi Xu +5
Ads supply personalization aims to balance the revenue and user engagement, two long-term objectives in social media ads, by tailoring the ad quantity and density. In the industry-…