222 citations · 591 across the 74 of their papers we have counts for
8 papers · 1 filter
Information-Distilling Quantizers
Alankrita Bhatt, Bobak Nazer, Or Ordentlich +1
Let and be dependent random variables. This paper considers the problem of designing a scalar quantizer for to maximize the mutual information between the quantizer's o…
Broadcasting on Random Directed Acyclic Graphs
Anuran Makur, Elchanan Mossel, Yury Polyanskiy
We study a generalization of the well-known model of broadcasting on trees. Consider a directed acyclic graph (DAG) with a unique source vertex , and suppose all other vertices…
Estimating Differential Entropy under Gaussian Convolutions
Ziv Goldfeld, Kristjan Greenewald, Yury Polyanskiy
This paper studies the problem of estimating the differential entropy , where and are independent -dimensional random variables with $Z\sim\mathcal{N}(0,σ^2 \mat…
Estimating Information Flow in Deep Neural Networks
Ziv Goldfeld, Ewout van den Berg, Kristjan Greenewald +4
We study the flow of information and the evolution of internal representations during deep neural network (DNN) training, aiming to demystify the compression aspect of the informat…
Application of information-percolation method to reconstruction problems on graphs
Yury Polyanskiy, Yihong Wu
In this paper we propose a method of proving impossibility results based on applying strong data-processing inequalities to estimate mutual information between sets of variables fo…
Information Storage in the Stochastic Ising Model
Ziv Goldfeld, Guy Bresler, Yury Polyanskiy
Most information storage devices write data by modifying the local state of matter, in the hope that sub-atomic local interactions stabilize the state for sufficiently long time, t…