Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings

Prafull Prakash, Saurabh Kumar Shashidhar, Wenlong Zhao +3

The current state-of-the-art task-oriented semantic parsing models use BERT or RoBERTa as pretrained encoders; these models have huge memory footprints. This poses a challenge to t…