In-Context Learning with Many Demonstration Examples

Mukai Li, Shansan Gong, Jiangtao Feng +4

Large pre-training language models (PLMs) have shown promising in-context learning abilities. However, due to the backbone transformer architecture, existing PLMs are bottlenecked…