Effectively Prompting Small-sized Language Models for Cross-lingual Tasks via Winning Tickets

Mingqi Li, Feng Luo

Current soft prompt methods yield limited performance when applied to small-sized models (fewer than a billion parameters). Deep prompt-tuning, which entails prepending parameters…