4 papers · 1 filter
Understanding the Curse of Unrolling
Sheheryar Mehmood, Florian Knoll, Peter Ochs
Algorithm unrolling is ubiquitous in machine learning, particularly in hyperparameter optimization and meta-learning, where Jacobians of solution mappings are computed by different…
Symmetries in PAC-Bayesian Learning
Armin Beck, Peter Ochs
Symmetries are known to improve the empirical performance of machine learning models, yet theoretical guarantees explaining these gains remain limited. Prior work has focused mainl…
A Generalization Result for Convergence in Learning-to-Optimize
Michael Sucker, Peter Ochs
Learning-to-optimize leverages machine learning to accelerate optimization algorithms. While empirical results show tremendous improvements compared to classical optimization algor…
A Probabilistic Framework for Learnable Optimization Algorithms
Peter Ochs, Michael Sucker
We propose a statistical-learning framework for optimization algorithms. The framework is based on probability distributions over optimization trajectories induced by a distributio…