17 citations · 43 across the 11 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2021
Sequential prediction under log-loss and misspecification
Meir Feder, Yury Polyanskiy
We consider the question of sequential prediction under the log-loss in terms of cumulative regret. Namely, given a hypothesis class of distributions, learner sequentially predicts…
cs.LG2020
The Information Bottleneck Problem and Its Applications in Machine Learning
Ziv Goldfeld, Yury Polyanskiy
Inference capabilities of machine learning (ML) systems skyrocketed in recent years, now playing a pivotal role in various aspect of society. The goal in statistical learning is to…
cs.LG2018
Estimating Information Flow in Deep Neural Networks
Ziv Goldfeld, Ewout van den Berg, Kristjan Greenewald +4
We study the flow of information and the evolution of internal representations during deep neural network (DNN) training, aiming to demystify the compression aspect of the informat…