Soft ascent-descent as a stable and flexible alternative to flooding

Matthew J. Holland, Kosuke Nakatani

As a heuristic for improving test accuracy in classification, the "flooding" method proposed by Ishida et al. (2020) sets a threshold for the average surrogate loss at training tim…