HuatuoGPT-3: RL-Only Domain Adaptation from Base Models

Junying Chen, Xinyuan Xie, Ziniu Li +7

Domain adaptation aims to turn a general-purpose large language model (LLM) into an expert for a target domain. While the dominant SFT+RL pipeline offers a convenient cold start, i…