LoRMA: Low-Rank Multiplicative Adaptation for LLMs

Harsh Bihany, Shubham Patel, Ashutosh Modi

Large Language Models have shown remarkable capabilities in the NLP domain. Their effectiveness can mainly be attributed to their ability to adapt to an array of downstream tasks.…