GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures

Ivan Chelombiev, Daniel Justus, Douglas Orr +4

Attention based language models have become a critical component in state-of-the-art natural language processing systems. However, these models have significant computational requi…