BoRA: Bayesian Hierarchical Low-Rank Adaption for Multi-Task Large Language Models

Simen Eide, Arnoldo Frigessi

This paper introduces Bayesian Hierarchical Low-Rank Adaption (BoRA), a novel method for finetuning multi-task Large Language Models (LLMs). Current finetuning approaches, such as…