Agile Online Model Selection: Resolving Adaptation Lag via Safeguarded Large Learning Rates

Kei Takemura, Ryuta Matsuno, Keita Sakuma

Maintaining predictive accuracy in non-stationary environments requires online model selection to adapt autonomously to unknown distribution shifts. However, existing tuning-free a…