12 papers
Large Language Models as Amortized Pareto-Front Generators for Constrained Bi-Objective Convex Optimization
Peipei Xu, SiYuan Ma, Yaohua Liu +4
Generating feasible Pareto fronts for constrained bi-objective continuous optimization is central to multi-criteria decision-making. Existing methods usually rely on iterative scal…
MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search
Sheng Zhang, Junyi Li, Yingyi Zhang +7
Recent advances in large language models (LLMs) have scaled the potential for reasoning and agentic search, wherein models autonomously plan, retrieve, and reason over external kno…
Personalized Deep Research: A User-Centric Framework, Dataset, and Hybrid Evaluation for Knowledge Discovery
Xiaopeng Li, Wenlin Zhang, Yingyi Zhang +6
Deep Research agents driven by LLMs have automated the scholarly discovery pipeline, from planning and query formulation to iterative web exploration. Yet they remain constrained b…
Kaczmarz Linear Attention
Jiaxuan Zou, Ruifeng Ren, Yong Liu
Long-context language modeling remains central to modern sequence modeling, but the quadratic cost of Transformer attention makes scaling computationally prohibitive. Linear recurr…
The Procrustean Bed of Time Series: The Optimization Bias in Point-wise Loss Functions
Rongyao Cai, Yuxi Wan, Kexin Zhang +6
Intuitively, a more deterministic time series should be easier to forecast. However, point-wise loss functions (e.g., MSE and MAE), serving as differentiable surrogates for the ide…
CoSteer: Collaborative Decoding-Time Personalization via Local Delta Steering
Hang Lv, Sheng Liang, Hao Wang +6
Personalization has become crucial for adapting models to the diverse and evolving needs of users across cultural, temporal, and contextual dimensions. While existing methods often…