Differentially Private In-context Learning via Sampling Few-shot Mixed with Zero-shot Outputs

James Flemings, Haosheng Gan, Hongyi Li +2

In-context learning (ICL) has shown promising improvement in downstream task adaptation of LLMs by augmenting prompts with relevant input-output examples (demonstrations). However,…