4 citations · 11 across the 9 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CV2024
Unveiling the Backbone-Optimizer Coupling Bias in Visual Representation Learning
Siyuan Li, Juanxi Tian, Zedong Wang +6
This paper delves into the interplay between vision backbones and optimizers, unvealing an inter-dependent phenomenon termed \textit{\textbf{b}ackbone-\textbf{o}ptimizer \textbf{c}…
cs.LG2024★ 3 cited
Switch EMA: A Free Lunch for Better Flatness and Sharpness
Siyuan Li, Zicheng Liu, Juanxi Tian +9
Exponential Moving Average (EMA) is a widely used weight averaging (WA) regularization to learn flat optima for better generalizations without extra cost in deep neural network (DN…