Operationalizing Specifications, In Addition to Test Sets for Evaluating Constrained Generative Models

Vikas Raunak, Matt Post, Arul Menezes

In this work, we present some recommendations on the evaluation of state-of-the-art generative models for constrained generation tasks. The progress on generative models has been r…