3 citations · 3 across the 4 of their papers we have counts for
5 papers · 1 filter
Convergence Analysis of the Lion Optimizer in Centralized and Distributed Settings
Wei Jiang, Lijun Zhang
In this paper, we analyze the convergence properties of the Lion optimizer. First, we establish that the Lion optimizer attains a convergence rate of …
Dual Adaptivity: Universal Algorithms for Minimizing the Adaptive Regret of Convex Functions
Lijun Zhang, Wenhao Yang, Guanghui Wang +2
To deal with changing environments, a new performance measure -- adaptive regret, defined as the maximum static regret over any interval, was proposed in online learning. Under the…
Learning Unnormalized Statistical Models via Compositional Optimization
Wei Jiang, Jiayu Qin, Lingyu Wu +3
Learning unnormalized statistical models (e.g., energy-based models) is computationally challenging due to the complexity of handling the partition function. To eschew this complex…
Smoothed Online Convex Optimization Based on Discounted-Normal-Predictor
Lijun Zhang, Wei Jiang, Jinfeng Yi +1
In this paper, we investigate an online prediction strategy named as Discounted-Normal-Predictor (Kapralov and Panigrahy, 2010) for smoothed online convex optimization (SOCO), in w…
Revisiting Smoothed Online Learning
Lijun Zhang, Wei Jiang, Shiyin Lu +1
In this paper, we revisit the problem of smoothed online learning, in which the online learner suffers both a hitting cost and a switching cost, and target two performance metrics:…