Regularizing Differentiable Architecture Search with Smooth Activation

Yanlin Zhou, Mostafa El-Khamy, Kee-Bong Song

Differentiable Architecture Search (DARTS) is an efficient Neural Architecture Search (NAS) method but suffers from robustness, generalization, and discrepancy issues. Many efforts…