RAILS: Retrieval-Augmented Incremental LLM Clustering at Scale

Armin Oliya, Aleksandra Sawczuk, Radosław Białobrzeski

Using a Large Language Model (LLM) as the clusterer at production scale is hard: prompts cannot hold the entire label space, and per-document serial processing does not deliver the…