Revisiting the Uniform Information Density Hypothesis in LLM Reasoning

Minju Gwak, Guijin Son, Jaehyung Kim

The Uniform Information Density (UID) hypothesis proposes that effective communication is achieved by maintaining a stable flow of information. In this work, we revisit this princi…