AutoMixQ: Self-Adjusting Quantization for High Performance Memory-Efficient Fine-Tuning

Changhai Zhou, Shiyang Zhang, Yuhua Zhou +2

Fine-tuning large language models (LLMs) under resource constraints is a significant challenge in deep learning. Low-Rank Adaptation (LoRA), pruning, and quantization are all effec…