Performance, Efficiency and Collapse -- Advantages and Challenges in Offline Post-training of Code LLMs

Abhinav Anand, Sanjana Reddy Pachika, Shweta Verma +1

Post-training with reinforcement learning (RL) is a critical phase in the development of code-generating large language models (LLMs), as it ensures adherence to instructions and t…