5 papers
Hallucination Rates in Language Generation
Debmalya Panigrahi, Fan Wei, Ian Zhang
Language generation in the limit is an elegant model introduced by Kleinberg and Mullainathan [KM24] to formally study language generation by an algorithm that learns solely based…
Validity, Sparse Holes, and Breadth in Language Generation: Banach Density, Topology, and Geometry
Jon Kleinberg, Fan Wei
Language generation in the limit, rooted in work of Gold and Angluin and revived by Kleinberg and Mullainathan, studies generation under minimal assumptions: an adversary enumerate…
Language Generation and Identification From Partial Enumeration: Tight Density Bounds and Topological Characterizations
Jon Kleinberg, Fan Wei
The success of large language models (LLMs) has motivated formal theories of language generation and learning. We study the framework of \emph{language generation in the limit}, wh…
SAFER: Advancing Safety Alignment via Efficient Ex-Ante Reasoning
Kehua Feng, Keyan Ding, Yuhao Wang +5
Recent advancements in large language models (LLMs) have accelerated progress toward artificial general intelligence, yet their potential to generate harmful content poses critical…
Density Measures for Language Generation
Jon Kleinberg, Fan Wei
The recent successes of large language models (LLMs) have led to a surge of theoretical research into language generation. A recent line of work proposes an abstract view, called l…