1 citations · 1 across the 5 of their papers we have counts for
5 papers
Berry-Esseen bounds for multivariate martingale difference sequences in the Kolmogorov distance
Weichen Wu, Dung Le, Arun Kumar Kuchibhotla +1
We derive new Gaussian approximations for finite martingale difference sequences in with respect to the Kolmogorov distance. Under appropriate conditions, our bounds…
Uncertainty quantification for Markov chain induced martingales with application to temporal difference learning
Weichen Wu, Yuting Wei, Alessandro Rinaldo
We establish novel and general high-dimensional concentration inequalities and Berry-Esseen bounds for vector-valued martingales induced by Markov chains. We apply these results to…
Statistical Inference for Policy Evaluation with Temporal Difference Learning
Weichen Wu, Gen Li, Yuting Wei +1
We investigate the statistical properties of Temporal Difference (TD) learning with Polyak-Ruppert averaging, arguably one of the most widely used algorithms in reinforcement learn…
On the estimation of persistence intensity functions and linear representations of persistence diagrams
Weichen Wu, Jisu Kim, Alessandro Rinaldo
The prevailing statistical approach to analyzing persistence diagrams is concerned with filtering out topological noise. In this paper, we adopt a different viewpoint and aim at es…
High-probability sample complexities for policy evaluation with linear function approximation
Gen Li, Weichen Wu, Yuejie Chi +3
This paper is concerned with the problem of policy evaluation with linear function approximation in discounted infinite horizon Markov decision processes. We investigate the sample…