4 papers
A Tight Lower Bound for Smooth Nonconvex Stochastic Optimization with Bounded Gradient Noise
Jikai Jin
We prove a sharp lower bound for smooth nonconvex stochastic optimization with uniformly bounded gradient noise. In the \(K=1\) fresh-sample model, every randomized adaptive algori…
Solving Inequality Proofs with Large Language Models
Pan Lu, Jiayi Sheng, Luna Lyu +4
Inequality proving, crucial across diverse scientific and mathematical fields, tests advanced reasoning skills such as discovering tight bounds and strategic theorem application. T…
Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation Learning
Jikai Jin, Vasilis Syrgkanis, Sham Kakade +1
Faithful evaluation of language model capabilities is crucial for deriving actionable insights that can inform model development. However, rigorous causal evaluations in this domai…
Structure-agnostic Optimality of Doubly Robust Learning for Treatment Effect Estimation
Jikai Jin, Vasilis Syrgkanis
Average treatment effect estimation is the most central problem in causal inference with application to numerous disciplines. While many estimation strategies have been proposed in…