4 papers
Manifold-Guided Attention Steering
Ian Li, Kapilesh Guruprasad, Raunak Sengupta +3
Large language models frequently produce errors in reasoning tasks despite possessing the underlying knowledge required for correct reasoning. One possible approach to improve reas…
Breaking the Factorization Barrier in Diffusion Language Models
Ian Li, Zilei Shao, Benjie Wang +3
Diffusion language models theoretically allow for efficient parallel generation but are practically hindered by the ``factorization barrier'': the assumption that simultaneously pr…
Learning Tractable Distributions Of Language Model Continuations
Gwen Yidou-Weng, Ian Li, Anji Liu +4
Controlled generation imposes sequence-level constraints (syntax, style, safety) that depend on future tokens, making exact conditioning of an autoregressive LM intractable. Tracta…
Towards an AI-Augmented Textbook
LearnLM Team, Google, : +34
Textbooks are a cornerstone of education, but they have a fundamental limitation: they are a one-size-fits-all medium. Any new material or alternative representation requires arduo…