Efficient Continual Pre-training for Building Domain Specific Large Language Models

Yong Xie, Karan Aggarwal, Aitzaz Ahmad

Large language models (LLMs) have demonstrated remarkable open-domain capabilities. LLMs tailored for a domain are typically trained entirely on domain corpus to excel at handling…