Preference Packing: Efficient Preference Optimization for Large Language Models

Jaekyung Cho

Resource-efficient training optimization techniques are becoming increasingly important as the size of large language models (LLMs) continues to grow. In particular, batch packing…