ZeroLM: Data-Free Transformer Architecture Search for Language Models

Zhen-Song Chen, Hong-Wei Ding, Xian-Jia Wang +1

Neural architecture search (NAS) provides a systematic framework for automating the design of neural network architectures, yet its widespread adoption is hindered by prohibitive c…