Towards Code-Oriented LM Embeddings for Surrogate-Assisted Neural Architecture Search

Pranav Somu, Advay Balakrishnan, Stepan Kravtsov +2

Developing effective surrogates (performance predictors) for Neural Architecture Search (NAS) typically requires expensive fine-tuning or the engineering of complex representations…