activity
20202022
most citedDemystifying Batch Normalization in ReLU Networks: Equivalent Convex Optimization Models and Implicit Regularization

9 citations · 27 across the 8 of their papers we have counts for

collaborators

8 papers

eess.IV2022

GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction

Batu Ozturkler, Arda Sahiner, Tolga Ergen +6

Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction. These networks unroll iterative optimization algorithms by alternating between phys…

cs.LG2022★ 3 cited

Unraveling Attention via Convex Duality: Analysis and Interpretations of Vision Transformers

Arda Sahiner, Tolga Ergen, Batu Ozturkler +3

Vision transformers using self-attention or its proposed alternatives have demonstrated promising results in many image related tasks. However, the underpinning inductive bias of a…

eess.IV2022★ 1 cited

Scale-Equivariant Unrolled Neural Networks for Data-Efficient Accelerated MRI Reconstruction

Beliz Gunel, Arda Sahiner, Arjun D. Desai +4

Unrolled neural networks have enabled state-of-the-art reconstruction performance and fast inference times for the accelerated magnetic resonance imaging (MRI) reconstruction task.…

cs.LG2022★ 2 cited

Fast Convex Optimization for Two-Layer ReLU Networks: Equivalent Model Classes and Cone Decompositions

Aaron Mishkin, Arda Sahiner, Mert Pilanci

We develop fast algorithms and robust software for convex optimization of two-layer neural networks with ReLU activation functions. Our work leverages a convex reformulation of the…

cs.LG2021★ 3 cited

Hidden Convexity of Wasserstein GANs: Interpretable Generative Models with Closed-Form Solutions

Arda Sahiner, Tolga Ergen, Batu Ozturkler +4

Generative Adversarial Networks (GANs) are commonly used for modeling complex distributions of data. Both the generators and discriminators of GANs are often modeled by neural netw…

cs.LG2021★ 9 cited

Demystifying Batch Normalization in ReLU Networks: Equivalent Convex Optimization Models and Implicit Regularization

Tolga Ergen, Arda Sahiner, Batu Ozturkler +3

Batch Normalization (BN) is a commonly used technique to accelerate and stabilize training of deep neural networks. Despite its empirical success, a full theoretical understanding…

cs.LG2020★ 6 cited

Convex Regularization Behind Neural Reconstruction

Arda Sahiner, Morteza Mardani, Batu Ozturkler +2

Neural networks have shown tremendous potential for reconstructing high-resolution images in inverse problems. The non-convex and opaque nature of neural networks, however, hinders…

cs.LG2020★ 3 cited

Vector-output ReLU Neural Network Problems are Copositive Programs: Convex Analysis of Two Layer Networks and Polynomial-time Algorithms

Arda Sahiner, Tolga Ergen, John Pauly +1

We describe the convex semi-infinite dual of the two-layer vector-output ReLU neural network training problem. This semi-infinite dual admits a finite dimensional representation, b…