3 citations · 5 across the 9 of their papers we have counts for
9 papers
On the Role of Preference Variance in Preference Optimization
Jiacheng Guo, Zihao Li, Jiahao Qiu +2
Direct Preference Optimization (DPO) has emerged as an important approach for learning from human preferences in aligning large language models (LLMs). However, collecting human pr…
MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations
Kaixuan Huang, Jiacheng Guo, Zihao Li +15
Large language models have demonstrated impressive performance on challenging mathematical reasoning tasks, which has triggered the discussion of whether the performance is achieve…
One-Layer Transformer Provably Learns One-Nearest Neighbor In Context
Zihao Li, Yuan Cao, Cheng Gao +5
Transformers have achieved great success in recent years. Interestingly, transformers have shown particularly strong in-context learning capability -- even without fine-tuning, the…
Global Convergence in Training Large-Scale Transformers
Cheng Gao, Yuan Cao, Zihao Li +5
Despite the widespread success of Transformers across various domains, their optimization guarantees in large-scale model settings are not well-understood. This paper rigorously an…
Diffusion Model for Data-Driven Black-Box Optimization
Zihao Li, Hui Yuan, Kaixuan Huang +4
Generative AI has redefined artificial intelligence, enabling the creation of innovative content and customized solutions that drive business practices into a new era of efficiency…
Regularized DeepIV with Model Selection
Zihao Li, Hui Lan, Vasilis Syrgkanis +2
In this paper, we study nonparametric estimation of instrumental variable (IV) regressions. While recent advancements in machine learning have introduced flexible methods for IV es…
Theoretical Insights for Diffusion Guidance: A Case Study for Gaussian Mixture Models
Yuchen Wu, Minshuo Chen, Zihao Li +2
Diffusion models benefit from instillation of task-specific information into the score function to steer the sample generation towards desired properties. Such information is coine…
Double Duality: Variational Primal-Dual Policy Optimization for Constrained Reinforcement Learning
Zihao Li, Boyi Liu, Zhuoran Yang +2
We study the Constrained Convex Markov Decision Process (MDP), where the goal is to minimize a convex functional of the visitation measure, subject to a convex constraint. Designin…
Sample Complexity of Preference-Based Nonparametric Off-Policy Evaluation with Deep Networks
Zihao Li, Xiang Ji, Minshuo Chen +1
A recently popular approach to solving reinforcement learning is with data from human preferences. In fact, human preference data are now used with classic reinforcement learning a…