NeuroTrails: Training with Dynamic Sparse Heads as the Key to Effective Ensembling

Bram Grooten, Farid Hasanov, Chenxiang Zhang +9

Model ensembles have long been a cornerstone for improving generalization and robustness in deep learning. However, their effectiveness often comes at the cost of substantial compu…