HetRL: Efficient Reinforcement Learning for LLMs in Heterogeneous Environments

Yongjun He, Shuai Zhang, Jiading Gai +5

As large language models (LLMs) continue to scale and new GPUs are released even more frequently, there is an increasing demand for LLM post-training in heterogeneous environments…