2 papers
cs.CL2021
Pruning Pretrained Encoders with a Multitask Objective
Patrick Xia, Richard Shin
The sizes of pretrained language models make them challenging and expensive to use when there are multiple desired downstream tasks. In this work, we adopt recent strategies for mo…
cs.CL2021
Few-Shot Semantic Parsing with Language Models Trained On Code
Richard Shin, Benjamin Van Durme
Large language models can perform semantic parsing with little training data, when prompted with in-context examples. It has been shown that this can be improved by formulating the…