307 citations · 907 across the 65 of their papers we have counts for
14 papers · 1 filter
Entropy of Bernoulli Measures Conditioned on Affine Subspaces and a Problem of Ancheta--Massey
Yihong Wu
A textbook result in information theory is that linear encoders achieve the entropy for lossless compression of Bernoulli source with parameter . For lossy compression, however,…
Random linear estimation with rotationally-invariant designs: Asymptotics at high temperature
Yufan Li, Zhou Fan, Subhabrata Sen +1
We study estimation in the linear model , in a Bayesian setting where has an entrywise i.i.d. prior and the design is rotationally-invariant in law. In…
Application of information-percolation method to reconstruction problems on graphs
Yury Polyanskiy, Yihong Wu
In this paper we propose a method of proving impossibility results based on applying strong data-processing inequalities to estimate mutual information between sets of variables fo…
Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy
Ashok Vardhan Makkuva, Yihong Wu
This paper addresses the correspondence between linear inequalities of Shannon entropy and differential entropy for sums of independent group-valued random variables. We show that…
Strong Data Processing Inequalities for Input Constrained Additive Noise Channels
Flavio P. Calmon, Yury Polyanskiy, Yihong Wu
This paper quantifies the intuitive observation that adding noise reduces available information by means of non-linear strong data processing inequalities. Consider the random vari…
Strong data-processing inequalities for channels and Bayesian networks
Yury Polyanskiy, Yihong Wu
The data-processing inequality, that is, for a Markov chain , has been the method of choice for proving impossibility (converse) results in infor…
Wasserstein continuity of entropy and outer bounds for interference channels
Yury Polyanskiy, Yihong Wu
It is shown that under suitable regularity conditions, differential entropy is a Lipschitz functional on the space of distributions on -dimensional Euclidean space with respect…
Minimax rates of entropy estimation on large alphabets via best polynomial approximation
Yihong Wu, Pengkun Yang
Consider the problem of estimating the Shannon entropy of a distribution over elements from independent samples. We show that the minimax mean-square error is within univer…
Dissipation of information in channels with input constraints
Yury Polyanskiy, Yihong Wu
One of the basic tenets in information theory, the data processing inequality states that output divergence does not exceed the input divergence for any channel. For channels witho…
Near Optimal Compressed Sensing of a Class of Sparse Low-Rank Matrices via Sparse Power Factorization
Kiryung Lee, Yihong Wu, Yoram Bresler
Compressed sensing of simultaneously sparse and low-rank matrices enables recovery of sparse signals from a few linear measurements of their bilinear form. One important question i…
Peak-to-average power ratio of good codes for Gaussian channel
Yury Polyanskiy, Yihong Wu
Consider a problem of forward error-correction for the additive white Gaussian noise (AWGN) channel. For finite blocklength codes the backoff from the channel capacity is inversely…
Optimal Detection For Sparse Mixtures
T. Tony Cai, Yihong Wu
Detection of sparse signals arises in a wide range of modern scientific studies. The focus so far has been mainly on Gaussian mixture models. In this paper, we consider the detecti…
Optimal Phase Transitions in Compressed Sensing
Yihong Wu, Sergio Verdú
Compressed sensing deals with efficient recovery of analog signals from linear encodings. This paper presents a statistical study of compressed sensing by modeling the input signal…
Estimation in Gaussian Noise: Properties of the Minimum Mean-Square Error
Dongning Guo, Yihong Wu, Shlomo Shamai +1
Consider the minimum mean-square error (MMSE) of estimating an arbitrary random variable from its observation contaminated by Gaussian noise. The MMSE can be regarded as a function…