Data-driven Clustering and Merging of Adapters for On-device Large Language Models

Ondrej Bohdal, Taha Ceritli, Mete Ozay +4

On-device large language models commonly employ task-specific adapters (e.g., LoRAs) to deliver strong performance on downstream tasks. While storing all available adapters is impr…