most citedBeyond Reward Hacking: Causal Rewards for Large Language Model Alignment

1 citations · 1 across the 21 of their papers we have counts for

collaborators

26 papers

math.CV2026

Markov maps and quasi-conformal deformations associated to geometrically finite Kleinian groups

Shengjin Huo, Wanting Shao

It is known that the dynamical properties of Kleinian groups with parabolic elements are much more complex than those without parabolic elements. In this paper, we mainly study the…

cs.LG2026

Discovered, Not Designed: Population Evolution for Collaborative and Compute-Intensive Model Discovery

Bo Peng, Lizhu Zhang, Yuhang Zhou +5

LLM-driven evolution enables iterative model development, but two practical goals remain underexplored: finding model designs that transfer across related tasks and sustaining impr…

cs.CL2026

CORAL: An LLM-Native Harness for Production Recommender Systems

Muhammad Rafay Azhar, Yuhang Zhou, Gilbert Jiang +7

Production recommender systems shape what billions of people see, and sustaining their performance requires continual optimization: as content, user behavior, and upstream models s…

cs.IR2026

ConnectionMind: Leveraging Social Networks and Large Language Models for Personalized Recommendation at Meta

Haoyu Han, Yuming Liu, Lei Huang +3

Modern recommendation systems on social media platforms such as Meta must model complex social relationships, including friendships, group memberships, and creator interactions, al…

cs.AI2026

Remember When It Matters: Proactive Memory Agent for Long-Horizon Agents

Yifan Wu, Lizhu Zhang, Yuhang Zhou +5

In long-horizon tasks, decision-relevant state is often scattered across an expanding trajectory, while the action agent must surface it and act. As trajectories grow, task require…

cs.AI2026

SWE-Together: Evaluating Coding Agents in Interactive User Sessions

Yifan Wu, Zhuokai Zhao, Songlin Li +8

Most coding-agent benchmarks are static: an agent receives a complete task description up front and is judged only by its final code. Real coding assistance is interactive, with us…

cs.IR2026

NEXT: Reasoning-Driven Video Recommendation via a Vision-Language Model

Yuming Liu, Hongye Yang, Harrison Zhao +5

We present NEXT (Next-interest EXploration Transformer), a reasoning-driven video recommendation framework that reasons over the video a user has just watched, infers the viewer's…

cs.CL2026

SAGE-OPD: Selective Agent-Guided Intervention for Multi-Turn On-Policy Distillation

Yuhang Zhou, Lizhu Zhang, Yifan Wu +5

On-policy distillation (OPD) improves student models by training them on trajectories induced by their own policy, making it a promising approach for mitigating exposure bias in ag…

cs.LG2026

OmniOPD: Logit-Free On-Policy Distillation via Speculative Verification

Yuhang Zhou, Lizhu Zhang, Yifan Wu +5

On-Policy Distillation (OPD) trains a student model on its own generative trajectories under dense token-level feedback from a stronger teacher, mitigating both the off-policy dist…

cs.CL2026

Agentic Recommender System with Hierarchical Belief-State Memory

Xiang Shen, Yuhang Zhou, Yifan Wu +8

Memory-augmented LLM agents have advanced personalized recommendation, yet existing approaches universally adopt flat memory representations that conflate ephemeral signals with st…

cs.CL2026

Synthetic Sandbox for Training Machine Learning Engineering Agents

Yuhang Zhou, Lizhu Zhang, Yifan Wu +4

As large language model agents advance beyond software engineering (SWE) tasks toward machine learning engineering (MLE), verifying agent behavior becomes orders of magnitude more…

cs.CL2026

LLM-Driven Reasoning for Constraint-Aware Feature Selection in Industrial Systems

Yuhang Zhou, Zhuokai Zhao, Ke Li +14

Feature selection is a crucial step in large-scale industrial machine learning systems, directly affecting model accuracy, efficiency, and maintainability. Traditional feature sele…

cs.CL2026

TARo: Token-level Adaptive Routing for LLM Test-time Alignment

Arushi Rai, Qiang Zhang, Hanqing Zeng +5

Large language models (LLMs) exhibit strong reasoning capabilities but typically require expensive post-training to reach high performance. Recent test-time alignment methods offer…

cs.LG2026

EBPO: Empirical Bayes Shrinkage for Stabilizing Group-Relative Policy Optimization

Kevin Han, Yuhang Zhou, Mingze Gao +6

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for enhancing the reasoning capabilities of Large Language Models (LLMs). However, dominant approaches li…

cs.IR2026

Efficient Sequential Recommendation for Long Term User Interest Via Personalization

Qiang Zhang, Hanchao Yu, Ivan Ji +14

Recent years have witnessed success of sequential modeling, generative recommender, and large language model for recommendation. Though the scaling law has been validated for seque…

cs.AI2026

Token-Level LLM Collaboration via FusionRoute

Nuoya Xiong, Yuhang Zhou, Hanqing Zeng +5

Large language models (LLMs) exhibit strengths across diverse domains. However, achieving strong performance across these domains with a single general-purpose model typically requ…

cs.LG2025

Exploring System 1 and 2 communication for latent reasoning in LLMs

Julian Coda-Forno, Zhuokai Zhao, Qiang Zhang +6

Should LLM reasoning live in a separate module, or within a single model's forward pass and representational space? We study dual-architecture latent reasoning, where a fluent Base…

cs.CL2025

Mixture-of-Minds: Multi-Agent Reinforcement Learning for Table Understanding

Yuhang Zhou, Mingrui Zhang, Ke Li +12

Understanding and reasoning over tables is a critical capability for many real-world applications. Large language models (LLMs) have shown promise on this task, but current approac…

cs.LG2025

Thought Communication in Multiagent Collaboration

Yujia Zheng, Zhuokai Zhao, Zijian Li +4

Natural language has long enabled human cooperation, but its lossy, ambiguous, and indirect nature limits the potential of collective intelligence. While machines are not subject t…

cs.CL2025

Let it Calm: Exploratory Annealed Decoding for Verifiable Reinforcement Learning

Chenghao Yang, Lin Gui, Chenxiao Yang +3

Reinforcement learning with verifiable rewards (RLVR) is a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs), yet its success hinges on eff…

cs.IR2025

RecoWorld: Building Simulated Environments for Agentic Recommender Systems

Fei Liu, Xinyu Lin, Hanchao Yu +12

We present RecoWorld, a blueprint for building simulated environments tailored to agentic recommender systems. Such environments give agents a proper training space where they can…

cs.CV2025

StreamMem: Query-Agnostic KV Cache Memory for Streaming Video Understanding

Yanlai Yang, Zhuokai Zhao, Satya Narayan Shukla +4

Multimodal large language models (MLLMs) have made significant progress in visual-language reasoning, but their ability to efficiently handle long videos remains limited. Despite r…

cs.CL2025

GEM: Empowering LLM for both Embedding Generation and Language Understanding

Caojin Zhang, Qiang Zhang, Ke Li +6

Large decoder-only language models (LLMs) have achieved remarkable success in generation and reasoning tasks, where they generate text responses given instructions. However, many a…

cs.CL2025

S'MoRE: Structural Mixture of Residual Experts for Parameter-Efficient LLM Fine-tuning

Hanqing Zeng, Yinglong Xia, Zhuokai Zhao +7

Fine-tuning pre-trained large language models (LLMs) presents a dual challenge of balancing parameter efficiency and model capacity. Existing methods like low-rank adaptations (LoR…