Showing cs.CLShow all
3 papers · 1 filter
cs.CL2026
Escaping Mode Collapse in LLM Generation via Geometric Regulation
Xin Du, Kumiko Tanaka-Ishii
Mode collapse is a persistent challenge in generative modeling and appears in autoregressive text generation as behaviors ranging from explicit looping to gradual loss of diversity…
cs.CL2025
Correlation Dimension of Auto-Regressive Large Language Models
Xin Du, Kumiko Tanaka-Ishii
Large language models (LLMs) have achieved remarkable progress in natural language generation, yet they continue to display puzzling behaviors -- such as repetition and incoherence…
cs.CL2024
Correlation Dimension of Natural Language in a Statistical Manifold
Xin Du, Kumiko Tanaka-Ishii
The correlation dimension of natural language is measured by applying the Grassberger-Procaccia algorithm to high-dimensional sequences produced by a large-scale language model. Th…