108 citations · 223 across the 9 of their papers we have counts for
10 papers
Mutual Information, Relative Entropy and Estimation Error in Semi-martingale Channels
Jiantao Jiao, Kartik Venkat, Tsachy Weissman
Fundamental relations between information and estimation have been established in the literature for the continuous-time Gaussian and Poisson channels, in a long line of work start…
Beyond Maximum Likelihood: from Theory to Practice
Jiantao Jiao, Kartik Venkat, Yanjun Han +1
Maximum likelihood is the most widely used statistical estimation technique. Recent work by the authors introduced a general methodology for the construction of estimators for func…
Maximum Likelihood Estimation of Functionals of Discrete Distributions
Jiantao Jiao, Kartik Venkat, Yanjun Han +1
We consider the problem of estimating functionals of discrete distributions, and focus on tight nonasymptotic analysis of the worst case squared error risk of widely used estimator…
Minimax Estimation of Functionals of Discrete Distributions
Jiantao Jiao, Kartik Venkat, Yanjun Han +1
We propose a general methodology for the construction and analysis of minimax estimators for a wide class of functionals of finite dimensional parameters, and elaborate on the case…
Relations between Information and Estimation in Discrete-Time Lévy Channels
Jiantao Jiao, Kartik Venkat, Tsachy Weissman
Fundamental relations between information and estimation have been established in the literature for the discrete-time Gaussian and Poisson channels. In this work, we demonstrate t…
Information Measures: the Curious Case of the Binary Alphabet
Jiantao Jiao, Thomas Courtade, Albert No +2
Four problems related to information divergence measures defined on finite alphabets are considered. In three of the cases we consider, we illustrate a contrast which arises betwee…
Justification of Logarithmic Loss via the Benefit of Side Information
Jiantao Jiao, Thomas Courtade, Kartik Venkat +1
We consider a natural measure of relevance: the reduction in optimal prediction risk in the presence of side information. For any given loss function, this relevance measure captur…
Information, Estimation, and Lookahead in the Gaussian channel
Kartik Venkat, Tsachy Weissman, Yair Carmon +1
We consider mean squared estimation with lookahead of a continuous-time signal corrupted by additive white Gaussian noise. We show that the mutual information rate function, i.e.,…
Reference Based Genome Compression
Bobbie Chern, Idoia Ochoa, Alexandros Manolakos +3
DNA sequencing technology has advanced to a point where storage is becoming the central bottleneck in the acquisition and mining of more data. Large amounts of data are vital for g…
Pointwise Relations between Information and Estimation in Gaussian Noise
Kartik Venkat, Tsachy Weissman
Many of the classical and recent relations between information and estimation in the presence of Gaussian noise can be viewed as identities between expectations of random quantitie…