109 citations · 269 across the 10 of their papers we have counts for
5 papers · 1 filter
Approximate Neural Architecture Search via Operation Distribution Learning
Xingchen Wan, Binxin Ru, Pedro M. Esperança +1
The standard paradigm in Neural Architecture Search (NAS) is to search for a fully deterministic architecture with specific operations and connections. In this work, we instead pro…
AUTOKD: Automatic Knowledge Distillation Into A Student Architecture Family
Roy Henha Eyono, Fabio Maria Carlucci, Pedro M Esperança +2
State-of-the-art results in deep learning have been improving steadily, in good part due to the use of larger models. However, widespread use is constrained by device hardware limi…
Batch Group Normalization
Xiao-Yun Zhou, Jiacheng Sun, Nanyang Ye +6
Deep Convolutional Neural Networks (DCNNs) are hard and time-consuming to train. Normalization is one of the effective solutions. Among previous normalization methods, Batch Normal…
Neural Architecture Generator Optimization
Binxin Ru, Pedro Esperanca, Fabio Carlucci
Neural Architecture Search (NAS) was first proposed to achieve state-of-the-art performance through the discovery of new architecture patterns, without human intervention. An over-…
NAS evaluation is frustratingly hard
Antoine Yang, Pedro M. Esperança, Fabio M. Carlucci
Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works lea…