Escaping Mode Collapse in LLM Generation via Geometric Regulation

Xin Du, Kumiko Tanaka-Ishii

Mode collapse is a persistent challenge in generative modeling and appears in autoregressive text generation as behaviors ranging from explicit looping to gradual loss of diversity…