Improving Differentiable Architecture Search via Self-Distillation

Xunyu Zhu, Jian Li, Yong Liu +1

Differentiable Architecture Search (DARTS) is a simple yet efficient Neural Architecture Search (NAS) method. During the search stage, DARTS trains a supernet by jointly optimizing…