Submodular Context Partitioning and Compression for In-Context Learning

Shaoyi Zheng, Canyu Zhang, Tianyi Zhou +1

In-context learning (ICL) enables efficient few-shot learning in large language models (LLMs) without training, but suffers from the quadratic input complexity of transformers, lim…