20 citations · 192 across the 51 of their papers we have counts for
3 papers · 1 filter
Estimating Differential Entropy under Gaussian Convolutions
Ziv Goldfeld, Kristjan Greenewald, Yury Polyanskiy
This paper studies the problem of estimating the differential entropy , where and are independent -dimensional random variables with $Z\sim\mathcal{N}(0,σ^2 \mat…
Estimating Information Flow in Deep Neural Networks
Ziv Goldfeld, Ewout van den Berg, Kristjan Greenewald +4
We study the flow of information and the evolution of internal representations during deep neural network (DNN) training, aiming to demystify the compression aspect of the informat…
Information Storage in the Stochastic Ising Model
Ziv Goldfeld, Guy Bresler, Yury Polyanskiy
Most information storage devices write data by modifying the local state of matter, in the hope that sub-atomic local interactions stabilize the state for sufficiently long time, t…