2 papers
cs.CL2025
Correlation Dimension of Auto-Regressive Large Language Models
Xin Du, Kumiko Tanaka-Ishii
Large language models (LLMs) have achieved remarkable progress in natural language generation, yet they continue to display puzzling behaviors -- such as repetition and incoherence…
cs.LG2024
Information-Theoretic Generative Clustering of Documents
Xin Du, Kumiko Tanaka-Ishii
We present {\em generative clustering} (GC) for clustering a set of documents, , by using texts generated by large language models (LLMs) instead of by clu…