Gradient-free Task-Conditioned Retrieval for On-Device In-Context Learning

Xinyu Luo, Hui Liu, Yihua Shao +3

On-device in-context learning (ICL) relies on pre-inference retrieval to select demonstrations for useful context before downstream model inference. This retrieval must exploit tas…