Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Mitigating Staleness in Asynchronous Pipeline Parallelism via Basis Rotation
Hyunji Jung, Sungbin Shin, Namhoon Lee
Asynchronous pipeline parallelism maximizes hardware utilization by eliminating the pipeline bubbles inherent in synchronous execution, offering a path toward efficient large-scale…
cs.LG2023
Critical Influence of Overparameterization on Sharpness-aware Minimization
Sungbin Shin, Dongyeop Lee, Maksym Andriushchenko +1
Sharpness-Aware Minimization (SAM) has attracted considerable attention for its effectiveness in improving generalization in deep neural network training by explicitly minimizing s…