Exploring Efficient Learning of Small BERT Networks with LoRA and DoRA

Daniel Frees, Aditri Bhagirath, Moritz Bolling

While Large Language Models (LLMs) have revolutionized artificial intelligence, fine-tuning LLMs is extraordinarily computationally expensive, preventing smaller businesses and res…