Towards Active Synthetic Data Generation for Finetuning Language Models

Samuel Kessler, Menglin Xia, Daniel Madrigal Diaz +5

A common and effective means for improving language model capabilities involves finetuning a ``student'' language model's parameters on generations from a more proficient ``teacher…