Scaling LLM Knowledge Boundaries via Distribution-Optimized Synthesis

Songze Li, Yarong Lan, Zhongpu Bo +16

Knowledge injection via synthetic data is crucial for enhancing Large Language Models (LLMs). However, current synthesis methods simply stop at preset token counts or fixed data ra…