5 papers
How to induce regularization in linear models: A guide to reparametrizing gradient flow
Hung-Hsu Chou, Johannes Maly, Dominik Stöger
In this work, we analyze the relation between reparametrizations of gradient flow and the induced implicit bias in linear models, which encompass various basic regression tasks. In…
Reliable one-bit quantization of bandlimited graph data via single-shot noise shaping
Johannes Maly, Anna Veselovska
Graph data are ubiquitous in natural sciences and machine learning. In this paper, we consider the problem of quantizing graph structured, bandlimited data to few bits per entry wh…
Efficient computation of the singular value decomposition with linear photonic circuits
Johannes Maly, Korbinian Neuner, Samarth Vadia
In light of today's massive data processing, digital computers are reaching fundamental performance limits due to physical limitations and energy consumption. For specific applicat…
Get rid of your constraints and reparametrize: A study in NNLS and implicit bias
Hung-Hsu Chou, Johannes Maly, Claudio Mayrink Verdun +2
Over the past years, there has been significant interest in understanding the implicit bias of gradient descent optimization and its connection to the generalization properties of…
More is Less: Inducing Sparsity via Overparameterization
Hung-Hsu Chou, Johannes Maly, Holger Rauhut
In deep learning it is common to overparameterize neural networks, that is, to use more parameters than training samples. Quite surprisingly training the neural network via (stocha…