BiT: Robustly Binarized Multi-distilled Transformer

Zechun Liu, Barlas Oguz, Aasish Pappu +5

Modern pre-trained transformers have rapidly advanced the state-of-the-art in machine learning, but have also grown in parameters and computational complexity, making them increasi…