16 citations · 17 across the 5 of their papers we have counts for
Showing 2025Show all
2 papers · 1 filter
cs.CL2025
Probing Geometry of Next Token Prediction Using Cumulant Expansion of the Softmax Entropy
Karthik Viswanathan, Sang Eon Park
We introduce a cumulant-expansion framework for quantifying how large language models (LLMs) internalize higher-order statistical structure during next-token prediction. By treatin…
cs.CL2025★ 1 cited
The Intrinsic Dimension of Prompts in Internal Representations of Large Language Models
Karthik Viswanathan, Yuri Gardinazzi, Giada Panerai +2
We study the geometry of token representations at the prompt level in large language models through the lens of intrinsic dimension. Viewing transformers as mean-field particle sys…