921 citations · 1k across the 30 of their papers we have counts for
5 papers · 1 filter
Concentration Inequalities for the Empirical Distribution
Jay Mardia, Jiantao Jiao, Ervin Tánczos +2
We study concentration inequalities for the Kullback--Leibler (KL) divergence between the empirical distribution and the true distribution. Applying a recursion technique, we impro…
Minimax redundancy for Markov chains with large state space
Kedar Shriram Tatwawadi, Jiantao Jiao, Tsachy Weissman
For any Markov source, there exist universal codes whose normalized codelength approaches the Shannon limit asymptotically as the number of samples goes to infinity. This paper inv…
Estimating the Fundamental Limits is Easier than Achieving the Fundamental Limits
Jiantao Jiao, Yanjun Han, Irena Fischer-Hwang +1
We show through case studies that it is easier to estimate the fundamental limits of data processing than to construct explicit algorithms to achieve those limits. Focusing on bina…
Mutual Information, Relative Entropy and Estimation Error in Semi-martingale Channels
Jiantao Jiao, Kartik Venkat, Tsachy Weissman
Fundamental relations between information and estimation have been established in the literature for the continuous-time Gaussian and Poisson channels, in a long line of work start…
Dependence Measures Bounding the Exploration Bias for General Measurements
Jiantao Jiao, Yanjun Han, Tsachy Weissman
We propose a framework to analyze and quantify the bias in adaptive data analysis. It generalizes that proposed by Russo and Zou'15, applying to measurements whose moment generatin…