118 citations · 363 across the 33 of their papers we have counts for
4 papers · 1 filter
The Impact of Reinitialization on Generalization in Convolutional Neural Networks
Ibrahim Alabdulmohsin, Hartmut Maennel, Daniel Keysers
Recent results suggest that reinitializing a subset of the parameters of a neural network during training can improve generalization, particularly for small training sets. We study…
A Generalized Lottery Ticket Hypothesis
Ibrahim Alabdulmohsin, Larisa Markeeva, Daniel Keysers +1
We introduce a generalization to the lottery ticket hypothesis in which the notion of "sparsity" is relaxed by choosing an arbitrary basis in the space of parameters. We present ev…
A Generalization of Classical Formulas in Numerical Integration and Series Convergence Acceleration
Ibrahim Alabdulmohsin
Summation formulas, such as the Euler-Maclaurin expansion or Gregory's quadrature, have found many applications in mathematics, ranging from accelerating series, to evaluating frac…
A Near-Optimal Algorithm for Debiasing Trained Machine Learning Models
Ibrahim Alabdulmohsin, Mario Lucic
We present a scalable post-processing algorithm for debiasing trained models, including deep neural networks (DNNs), which we prove to be near-optimal by bounding its excess Bayes…