21 papers
KV-PRM: Efficient Process Reward Modeling via KV-Cache Transfer for Multi-Agent Test-Time Scaling
Peng Kuang, Haibo Jin, Xiaoyu Han +5
Process Reward Models (PRMs) have been proven to be highly effective in guiding test-time scaling (TTS) methods, which significantly boost the capabilities of LLM-based multi-agent…
Closing the Loop on Latent Reasoning via Test-Time Reconstruction
Xiaopeng Yuan, Haibo Jin, Ye Yu +4
Recent work moves intermediate reasoning from natural-language traces into latent or cache-level representations to reduce token overhead and avoid a discrete communication bottlen…
Agent Primitives: Reusable Latent Building Blocks for Multi-Agent Systems
Haibo Jin, Peng Kuang, Ye Yu +2
While existing multi-agent systems (MAS) can handle complex problems by enabling collaboration among multiple agents, they are often highly task-specific, relying on manually craft…
SCI-Defense: Defending Manipulation Attacks from Generative Engine Optimization
Xucheng Yu, Haibo Jin, Huimin Zeng +1
LLM-based ranking systems are vulnerable to Generative Engine Optimization (GEO) attacks, where adversaries inject semantic signals into product descriptions to artificially boost…
TextReg: Mitigating Prompt Distributional Overfitting via Regularized Text-Space Optimization
Lucheng Fu, Ye Yu, Yiyang Wang +4
Large language models (LLMs) are highly sensitive to the prompts used to specify task objectives and behavioral constraints. Many recent prompt optimization methods iteratively rew…
Preference Tuning as Spectral Update Reorganization
Peiyan Zhang, Haibo Jin, Liying Kang +1
Preference-based post-training is usually understood through endpoint behavior, yet the learned update that produces this behavior remains largely opaque. We study RLHF and related…