SOL: Measuring Gaps between Text Distributions by Double Sliced Wasserstein Metrics

Gregor Kornhardt, Moritz Piening, Jannis Chemseddine +1

Evaluating text generation requires measuring how well the generated distribution matches the data distribution. For autoregressive models, this is done by the perplexity. Diffusio…