ALPS: Attention Localization and Pruning Strategy for Efficient Alignment of Large Language Models

Hao Chen, Haoze Li, Zhiqing Xiao +6

Aligning general-purpose large language models (LLMs) to downstream tasks often incurs significant training adjustment costs. Prior research has explored various avenues to enhance…