Zero-Order Sharpness-Aware Minimization

Yao Fu, Yihang Jin, Chunxia Zhang +3

Prompt learning has become a key method for adapting large language models to specific tasks with limited data. However, traditional gradient-based optimization methods for tuning…