5 citations · 8 across the 7 of their papers we have counts for
8 papers · 1 filter
Provable Test-Time Scaling for Beam Search in LLM Reasoning
Qijia He, Yu Huang, Yuan Cheng +2
Beam-search-based test-time methods provide an effective way to improve large language model (LLM) performance on long-horizon generation by pruning invalid reasoning paths early,…
Agentic Transformers Provably Learn to Search via Reinforcement Learning
Tong Yang, Yu Huang, Yingbin Liang +1
Tree search is a central abstraction behind many language-agent reasoning and decision-making tasks: agents must explore actions, remember failures, and backtrack toward promising…
Transformers Provably Learn Directed Acyclic Graphs via Kernel-Guided Mutual Information
Yuan Cheng, Yu Huang, Zhe Xiong +2
Uncovering hidden graph structures underlying real-world data is a critical challenge with broad applications across scientific domains. Recently, transformer-based models leveragi…
Multi-head Transformers Provably Learn Symbolic Multi-step Reasoning via Gradient Descent
Tong Yang, Yu Huang, Yingbin Liang +1
Transformers have demonstrated remarkable capabilities in multi-step reasoning tasks. However, understandings of the underlying mechanisms by which they acquire these abilities thr…
In-Context Learning with Representations: Contextual Generalization of Trained Transformers
Tong Yang, Yu Huang, Yingbin Liang +1
In-context learning (ICL) refers to a remarkable capability of pretrained large language models, which can learn a new task given a few examples during inference. However, theoreti…
Accelerating Convergence of Score-Based Diffusion Models, Provably
Gen Li, Yu Huang, Timofey Efimov +3
Score-based diffusion models, while achieving remarkable empirical performance, often suffer from low sampling speed, due to extensive function evaluations needed during the sampli…
A Theoretical Analysis of Self-Supervised Learning for Vision Transformers
Yu Huang, Zixin Wen, Yuejie Chi +1
Self-supervised learning has become a cornerstone in computer vision, primarily divided into reconstruction-based methods like masked autoencoders (MAE) and discriminative methods…
In-Context Convergence of Transformers
Yu Huang, Yuan Cheng, Yingbin Liang
Transformers have recently revolutionized many domains in modern machine learning and one salient discovery is their remarkable in-context learning capability, where models can sol…