Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Navigating Data Corruption in Machine Learning: Balancing Quality, Quantity, and Imputation Strategies
Qi Liu, Wanjing Ma
Data corruption, including missing and noisy data, poses significant challenges in real-world machine learning. This study investigates the effects of data corruption on model perf…
cs.LG2024
The Epochal Sawtooth Phenomenon: Unveiling Training Loss Oscillations in Adam and Other Optimizers
Qi Liu, Wanjing Ma
In this paper, we identify and analyze a recurring training loss pattern, which we term the \textit{Epochal Sawtooth Phenomenon (ESP)}, commonly observed during training with adapt…