most citedSparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers

6 citations · 13 across the 6 of their papers we have counts for

collaborators
Showing cs.CVShow all

1 paper · 1 filter

cs.CV2022★ 3 cited

Training Your Sparse Neural Network Better with Any Mask

Ajay Jaiswal, Haoyu Ma, Tianlong Chen +2

Pruning large neural networks to create high-quality, independently trainable sparse masks, which can maintain similar performance to their dense counterparts, is very desirable du…