PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint

Bhoomit Vasani, Jack FitzGerald, Anjie Fang +1

We introduce PHLoRA (Pronounced "flora"). (Post-hoc LoRA), a simple yet powerful method to extract low-rank adaptation adapters from full-rank fine-tuned models without requiring a…