SHRP: Specialized Head Routing and Pruning for Efficient Encoder Compression

Zeli Su, Ziyin Zhang, Wenzheng Zhang +3

Transformer encoders are widely deployed in large-scale web services for natural language understanding tasks such as text classification, semantic retrieval, and content ranking.…