PA&DA: Jointly Sampling PAth and DAta for Consistent NAS

Shun Lu, Yu Hu, Longxing Yang +4

Based on the weight-sharing mechanism, one-shot NAS methods train a supernet and then inherit the pre-trained weights to evaluate sub-models, largely reducing the search cost. Howe…