3 papers
cs.CL2026
Escaping Mode Collapse in LLM Generation via Geometric Regulation
Xin Du, Kumiko Tanaka-Ishii
Mode collapse is a persistent challenge in generative modeling and appears in autoregressive text generation as behaviors ranging from explicit looping to gradual loss of diversity…
cs.CL2025
Correlation Dimension of Auto-Regressive Large Language Models
Xin Du, Kumiko Tanaka-Ishii
Large language models (LLMs) have achieved remarkable progress in natural language generation, yet they continue to display puzzling behaviors -- such as repetition and incoherence…
cs.LG2024
Information-Theoretic Generative Clustering of Documents
Xin Du, Kumiko Tanaka-Ishii
We present {\em generative clustering} (GC) for clustering a set of documents, , by using texts generated by large language models (LLMs) instead of by clu…