Xin Du

activity

20232026

most citedCorrelation Dimension of Natural Language in a Statistical Manifold

2 citations · 3 across the 6 of their papers we have counts for

collaborators

Showing 2024Show all

3 papers · 1 filter

cs.LG2024

Information-Theoretic Generative Clustering of Documents

Xin Du, Kumiko Tanaka-Ishii

We present {\em generative clustering} (GC) for clustering a set of documents, $X$ , by using texts $Y$ generated by large language models (LLMs) instead of by clu…

cs.IR2024★ 1 cited

Bottleneck-Minimal Indexing for Generative Document Retrieval

Xin Du, Lixin Xiu, Kumiko Tanaka-Ishii

We apply an information-theoretic perspective to reconsider generative document retrieval (GDR), in which a document $x \in X$ is indexed by $t \in T$ , and a neural autoregressive…

cs.CL2024★ 2 cited

Correlation Dimension of Natural Language in a Statistical Manifold

Xin Du, Kumiko Tanaka-Ishii

The correlation dimension of natural language is measured by applying the Grassberger-Procaccia algorithm to high-dimensional sequences produced by a large-scale language model. Th…