Dynamic Noise Preference Optimization: Self-Improvement of Large Language Models with Self-Synthetic Data

Haoyan Yang, Khiem Le, Ting Hua +7

Although LLMs have achieved significant success, their reliance on large volumes of human-annotated data has limited their potential for further scaling. In this situation, utilizi…