Training BatchNorm Only in Neural Architecture Search and Beyond

Yichen Zhu, Jie Du, Yuqin Zhu +4

This work investigates the usage of batch normalization in neural architecture search (NAS). Specifically, Frankle et al. find that training BatchNorm only can achieve nontrivial p…