455 citations · 652 across the 10 of their papers we have counts for
4 papers · 1 filter
A Variational Perspective on Solving Inverse Problems with Diffusion Models
Morteza Mardani, Jiaming Song, Jan Kautz +1
Diffusion models have emerged as a key pillar of foundation models in visual domains. One of their critical applications is to universally solve different downstream inverse tasks…
Unraveling Attention via Convex Duality: Analysis and Interpretations of Vision Transformers
Arda Sahiner, Tolga Ergen, Batu Ozturkler +3
Vision transformers using self-attention or its proposed alternatives have demonstrated promising results in many image related tasks. However, the underpinning inductive bias of a…
Convex Regularization Behind Neural Reconstruction
Arda Sahiner, Morteza Mardani, Batu Ozturkler +2
Neural networks have shown tremendous potential for reconstructing high-resolution images in inverse problems. The non-convex and opaque nature of neural networks, however, hinders…
Degrees of Freedom Analysis of Unrolled Neural Networks
Morteza Mardani, Qingyun Sun, Vardan Papyan +3
Unrolled neural networks emerged recently as an effective model for learning inverse maps appearing in image restoration tasks. However, their generalization risk (i.e., test mean-…