OTARo: Once Tuning for All Precisions toward Robust On-Device LLMs

Shaoyuan Chen, Zhixuan Chen, Dawei Yang +2

Large Language Models (LLMs) fine-tuning techniques not only improve the adaptability to diverse downstream tasks, but also mitigate adverse effects of model quantization. Despite…