most citedImproving In-Context Learning with Reasoning Distillation

1 citations · 1 across the 24 of their papers we have counts for

collaborators

28 papers

math-ph2026

Counterexamples to the total-current Hohenberg-Kohn conjecture

Andre Laestadius, Mihály A. Csirik

The total-current Hohenberg-Kohn conjecture asserts that the ground-state particle density and total current determine the scalar potential up to an additive constant and the vecto…

cs.AI2026

Does Latent Chain-of-Thought Actually Reason? A Single, Unifying Taxonomy for Latent Reasoning

Jingjie Qiu, Sheldon Yu, Xunyi Jiang +6

Latent chain-of-thought replaces written reasoning steps with continuous hidden states, giving models additional steps to compute before answering. It remains unclear what computat…

cs.AI2026

Failure Is the Mother of Success: Recovering Supervision with Grounding Hindsight

Sheldon Yu, Tong Yu, Nikki Lijing Kuang +6

When every rollout for a problem fails, GRPO receives neither a successful exemplar nor a nonzero group-relative advantage, so it learns nothing from exactly the problems it most n…

cs.CR2026

OPBackdoor: Opportunistic Backdoors via Alibi-Aligned Reasoning

Eric Xue, Ruiyi Zhang, Kevin Xue +3

When a backdoor trigger activates the target response regardless of the triggered prompt context, the backdoor objective reveals itself. Challenging this trigger-sufficient formula…

cs.AI2026

Mechanist: AI as a Scientific Instrument for Discovering the Mechanisms of Intelligence

Mengru Wang, Junfeng Fang, Shuofei Qiao +17

AI models are increasingly used in scientific discovery and human decision-making. Yet how AI models work and what risks they pose remain poorly understood. As AI development becom…

cs.AI2026

Toward Latent Language Model Skills Steering and Optimization: An Empirical Study

Xunyi Jiang, Junda Wu, Yuxin Xiong +6

Skills, as a useful abstraction for the procedural capabilities of large language models (LLMs), capture how models perform structured, multi-step reasoning and program execution.…

cs.CL2026

Filesystem-Based Memory for LLM Agents: Organization, Evolution, and Sustainability

Sizhe Zhou, Sheldon Yu, Hui Wei +8

Deployed LLM agents increasingly keep their long-term memory as a filesystem: a directory tree of markdown files that the agent itself reads, writes, and reorganizes through generi…

cs.AI2026

How Hard Does It Think? Analyzing Step-Aware Reasoning Energy in LLM Chain-of-Thought Trajectories

Hui Wei, Junda Wu, Sheldon Yu +8

Understanding how computational effort is allocated across individual chain-of-thought (CoT) reasoning steps remains an open challenge: existing interpretability methods rely on ou…

cs.LG2026

RRPO: Reference-Relative Policy Optimization with Stratified Conditional Rollouts

Yuxin Xiong, Xunyi Jiang, Rohan Surana +8

Group Relative Policy Optimization (GRPO) has shown strong effectiveness in reinforcement learning from verifiable feedback, where sampled rollouts can be compared within a group u…

cs.CL2026

Spider 2.0-AIFunc: Extending Real-World Text-to-SQL to AI-Native SQL Workflows

Tianyang Liu, Canwen Xu, Fangyu Lei +6

Major cloud data platforms now expose large language model capabilities as native SQL functions, enabling analysts to perform classification, filtering, sentiment analysis, extract…

cs.CL2026

Efficient and Trainable Language Model Test-Time Scaling via Local Branch Routing

Yutong Yin, Mingyu Jin, Jin Pan +12

Test-time scaling improves language-model reasoning, but existing approaches often face a difficult trade-off: long chain-of-thought sampling remains single-threaded, while sentenc…

cs.CL2026

Agentic Chain-of-Thought Steering for Efficient and Controllable LLM Reasoning

Yu Xia, Zhouhang Xie, Xin Xu +4

Large language models improve final-answer accuracy through extended chain-of-thought reasoning, but often spend tokens inefficiently and offer little inference-time control. Exist…

cs.IR2026

MLPs are Efficient Distilled Generative Recommenders

Zitian Guo, Yupeng Hou, Clark Mingxuan Ju +2

Generative recommendation models employing Semantic IDs (SIDs) exhibit strong potential, yet their practical deployment is bottlenecked by the high inference latency of beam-expand…

cs.AI2026

OLIVIA: Online Learning via Inference-time Action Adaptation for Decision Making in LLM ReAct Agents

Sheldon Yu, Junda Wu, Xintong Li +6

Large language model agents interleave reasoning, action selection, and observation to solve sequential decision-making tasks. In deployed settings where agents repeatedly handle r…

cs.LG2026

MASS-DPO: Multi-negative Active Sample Selection for Direct Policy Optimization

Rohan Surana, Xintong Li, Sheldon Yu +7

Multi-negative preference optimization under the Plackett--Luce (PL) model extends Direct Preference Optimization (DPO) by leveraging comparative signals across one preferred and m…

cs.LG2026

Skill-R1: Agent Skill Evolution via Reinforcement Learning

Yash Vishe, Rohan Surana, Xunyi Jiang +8

Agentic large language models often rely on skills, reusable natural language procedures that guide planning, action, and tool use. In practice, skills are typically improved throu…

cs.IR2026

Reddit2Deezer: A Scalable Dataset for Real-World Grounded Conversational Music Recommendation

Haven Kim, Julian McAuley

Conversational music recommendation (CMR) research currently faces a tradeoff between authentic dialogue corpora that are limited in scale and synthesized corpora that scale up but…

cs.CL2026

CocoaBench: Evaluating Unified Digital Agents in the Wild

CocoaBench Team, Shibo Hao, Zhining Zhang +29

LLM agents now perform strongly in software engineering, deep research, GUI automation, and various other applications, while recent agent scaffolds and models are increasingly int…

cs.LG2026

Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learning

Rohan Surana, Gagan Mundada, Xunyi Jiang +19

Reinforcement learning (RL) has become a central post-training tool for improving the reasoning abilities of large language models (LLMs). In these systems, the rollout, the trajec…

cs.LG2026

CSyMR: Benchmarking Compositional Music Information Retrieval in Symbolic Music Reasoning

Boyang Wang, Yash Vishe, Xin Xu +4

Natural language information needs over symbolic music scores rarely reduce to a single step lookup. Many queries require compositional Music Information Retrieval (MIR) that extra…

cs.AI2026

ThinkRouter: Efficient Reasoning via Routing Thinking between Latent and Discrete Spaces

Xin Xu, Tong Yu, Xiang Chen +3

Recent work explores latent reasoning to improve reasoning efficiency by replacing explicit reasoning trajectories with continuous representations in a latent space, yet its effect…

cs.SD2025

Evaluating Music Context Preservation: A Multi-facet Framework for Music Editing Systems

Yash Vishe, Eric Xue, Xunyi Jiang +4

Music editing plays a vital role in modern music production, with applications in film, broadcasting, and game development. Recent advances in music editing systems have enabled di…

cs.CL2025

When Benchmarks Age: Temporal Misalignment through Large Language Model Factuality Evaluation

Xunyi Jiang, Dingyi Chang, Julian McAuley +1

The rapid evolution of large language models (LLMs) and the real world has outpaced the static nature of widely used evaluation benchmarks, raising concerns about their reliability…

cs.CL2025

BiasFreeBench: a Benchmark for Mitigating Bias in Large Language Model Responses

Xin Xu, Xunzhi He, Churan Zhi +3

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparison…