31 citations · 51 across the 12 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2024★ 2 cited
ReaL: Efficient RLHF Training of Large Language Models with Parameter Reallocation
Zhiyu Mei, Wei Fu, Kaiwei Li +3
Reinforcement Learning from Human Feedback (RLHF) is a pivotal technique for empowering large language model (LLM) applications. Compared with the supervised training process of LL…
cs.DC2023
SRL: Scaling Distributed Reinforcement Learning to Over Ten Thousand Cores
Zhiyu Mei, Wei Fu, Jiaxuan Gao +3
The ever-growing complexity of reinforcement learning (RL) tasks demands a distributed system to efficiently generate and process a massive amount of data. However, existing open-s…