78 citations · 130 across the 30 of their papers we have counts for
3 papers · 1 filter
Adaptive Sequential Machine Learning
Craig Wilson, Yuheng Bu, Venugopal Veeravalli
A framework previously introduced in [3] for solving a sequence of stochastic optimization problems with bounded changes in the minimizers is extended and applied to machine learni…
Information-Theoretic Understanding of Population Risk Improvement with Model Compression
Yuheng Bu, Weihao Gao, Shaofeng Zou +1
We show that model compression can improve the population risk of a pre-trained model, by studying the tradeoff between the decrease in the generalization error and the increase in…
Tightening Mutual Information Based Bounds on Generalization Error
Yuheng Bu, Shaofeng Zou, Venugopal V. Veeravalli
An information-theoretic upper bound on the generalization error of supervised learning algorithms is derived. The bound is constructed in terms of the mutual information between e…