1 citations · 1 across the 7 of their papers we have counts for
5 papers · 1 filter
Efficient Preconditioned Optimization Methods with Frequent Directions
Sifan Yang, Yuanyu Wan, Yibo Wang +1
Adaptive optimization methods have received considerable attention in recent years due to their strong empirical performance. However, they generally require maintaining a precondi…
From Switching to Dynamic Regret: A Simple Reduction via Unbiased Random Sequences
Yibo Wang, Wenhao Yang, Sifan Yang +3
In non-stationary online learning, dynamic regret has attracted increasing attention as a measure of how well an online learner performs against a time-varying comparator sequence.…
SPACE: Noise Contrastive Estimation Stabilizes Self-Play Fine-Tuning for Large Language Models
Yibo Wang, Qing-Guo Chen, Zhao Xu +3
Self-play fine-tuning has demonstrated promising abilities in adapting large language models (LLMs) to downstream tasks with limited real-world data. The basic principle is to iter…
Discounted Online Convex Optimization: Uniform Regret Across a Continuous Interval
Wenhao Yang, Sifan Yang, Lijun Zhang
Reflecting the greater significance of recent history over the distant past in non-stationary environments, -discounted regret has been introduced in online convex optimization…
Universal Online Convex Optimization with Projection per Round
Wenhao Yang, Yibo Wang, Peng Zhao +1
To address the uncertainty in function types, recent progress in online convex optimization (OCO) has spurred the development of universal algorithms that simultaneously attain min…