40 citations · 151 across the 17 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022★ 5 cited
Limitations of Information-Theoretic Generalization Bounds for Gradient Descent Methods in Stochastic Convex Optimization
Mahdi Haghifam, Borja Rodríguez-Gálvez, Ragnar Thobaben +3
To date, no "information-theoretic" frameworks for reasoning about generalization error have been shown to establish minimax rates for gradient descent in the setting of stochastic…
cs.LG2022
Understanding Generalization via Leave-One-Out Conditional Mutual Information
Mahdi Haghifam, Shay Moran, Daniel M. Roy +1
We study the mutual information between (certain summaries of) the output of a learning algorithm and its training data, conditional on a supersample of i.i.d. data from…