Shared Autoregressive Context Can Distort Relationships in Synthetic Data

Thomas S. Robinson

Large language models can generate several records within one autoregressive completion, making earlier answers available as context for later records. This paper shows that such s…