3 papers
cs.LG2026
Compander-Aligned Query Geometry for Quantized Zeroth-Order Optimization
Yao Shu, Zilin Zhu
Low-bit forward evaluation is an attractive route to memory-efficient zeroth-order (ZO) adaptation: the optimizer needs only scalar losses, and the model can be queried near deploy…
cs.LG2026
Why Zeroth-Order Adaptation May Forget Less: A Randomized Shaping Theory
Yao Shu, Jian Mu, Zhongxiang Dai
Continual learning requires new-task adaptation without damaging previously acquired capabilities. Recent forward-pass and zeroth-order (ZO) results show that low-query adaptation…
cs.LG2025
Meta-Prompt Optimization for LLM-Based Sequential Decision Making
Mingze Kong, Zhiyong Wang, Yao Shu +1
Large language models (LLMs) have recently been employed as agents to solve sequential decision-making tasks such as Bayesian optimization and multi-armed bandits (MAB). These work…