132 citations · 167 across the 10 of their papers we have counts for
Showing 2022 · cs.CLShow all
2 papers · 2 filters
cs.CL2022
STT: Soft Template Tuning for Few-Shot Adaptation
Ping Yu, Wei Wang, Chunyuan Li +3
Prompt tuning has been an extremely effective tool to adapt a pre-trained model to downstream tasks. However, standard prompt-based methods mainly consider the case of sufficient d…
cs.CL2022
Efficient Language Modeling with Sparse all-MLP
Ping Yu, Mikel Artetxe, Myle Ott +4
All-MLP architectures have attracted increasing interest as an alternative to attention-based models. In NLP, recent work like gMLP shows that all-MLPs can match Transformers in la…