Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024
On PI Controllers for Updating Lagrange Multipliers in Constrained Optimization
Motahareh Sohrabi, Juan Ramirez, Tianyue H. Zhang +2
Constrained optimization offers a powerful framework to prescribe desired behaviors in neural network models. Typically, constrained problems are solved via their min-max Lagrangia…
cs.LG2023
Weight-Sharing Regularization
Mehran Shakerinava, Motahareh Sohrabi, Siamak Ravanbakhsh +1
Weight-sharing is ubiquitous in deep learning. Motivated by this, we propose a "weight-sharing regularization" penalty on the weights of a neural network, defi…