40 citations · 91 across the 22 of their papers we have counts for
13 papers · 1 filter
Stochastic Regret Guarantees for Online Zeroth- and First-Order Bilevel Optimization
Parvin Nazari, Bojian Hou, Davoud Ataee Tarzanagh +2
Online bilevel optimization (OBO) is a powerful framework for machine learning problems where both outer and inner objectives evolve over time, requiring dynamic updates. Current O…
Truncated Matrix Completion - An Empirical Study
Rishhabh Naik, Nisarg Trivedi, Davoud Ataee Tarzanagh +1
Low-rank Matrix Completion (LRMC) describes the problem where we wish to recover missing entries of partially observed low-rank matrix. Most existing matrix completion work deals w…
Clustering Alzheimer's Disease Subtypes via Similarity Learning and Graph Diffusion
Tianyi Wei, Shu Yang, Davoud Ataee Tarzanagh +6
Alzheimer's disease (AD) is a complex neurodegenerative disorder that affects millions of people worldwide. Due to the heterogeneous nature of AD, its diagnosis and treatment pose…
Optimizing Attention with Mirror Descent: Generalized Max-Margin Token Selection
Addison Kristanto Julistiono, Davoud Ataee Tarzanagh, Navid Azizan
Attention mechanisms have revolutionized several domains of artificial intelligence, such as natural language processing and computer vision, by enabling models to selectively focu…
Fairness-Aware Estimation of Graphical Models
Zhuoping Zhou, Davoud Ataee Tarzanagh, Bojian Hou +2
This paper examines the issue of fairness in the estimation of graphical models (GMs), particularly Gaussian, Covariance, and Ising models. These models play a vital role in unders…
Fair Canonical Correlation Analysis
Zhuoping Zhou, Davoud Ataee Tarzanagh, Bojian Hou +5
This paper investigates fairness and bias in Canonical Correlation Analysis (CCA), a widely used statistical technique for examining the relationship between two sets of variables.…
Transformers as Support Vector Machines
Davoud Ataee Tarzanagh, Yingcong Li, Christos Thrampoulidis +1
Since its inception in "Attention Is All You Need", transformer architecture has led to revolutionary advancements in NLP. The attention layer within the transformer admits a seque…
Federated Multi-Sequence Stochastic Approximation with Local Hypergradient Estimation
Davoud Ataee Tarzanagh, Mingchen Li, Pranay Sharma +1
Stochastic approximation with multiple coupled sequences (MSA) has found broad applications in machine learning as it encompasses a rich class of problems including bilevel optimiz…
Max-Margin Token Selection in Attention Mechanism
Davoud Ataee Tarzanagh, Yingcong Li, Xuechen Zhang +1
Attention mechanism is a central component of the transformer architecture which led to the phenomenal success of large language models. However, the theoretical principles underly…
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming
Parvin Nazari, Ahmad Mousavi, Davoud Ataee Tarzanagh +1
Bilevel programming has recently received attention in the literature due to its wide range of applications, including reinforcement learning and hyper-parameter optimization. Howe…
FedNest: Federated Bilevel, Minimax, and Compositional Optimization
Davoud Ataee Tarzanagh, Mingchen Li, Christos Thrampoulidis +1
Standard federated optimization methods successfully apply to stochastic problems with single-level structure. However, many contemporary ML problems -- including adversarial robus…
Identification and Adaptive Control of Markov Jump Systems: Sample Complexity and Regret Bounds
Yahya Sattar, Zhe Du, Davoud Ataee Tarzanagh +3
Learning how to effectively control unknown dynamical systems is crucial for intelligent autonomous systems. This task becomes a significant challenge when the underlying dynamics…
DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization
Parvin Nazari, Davoud Ataee Tarzanagh, George Michailidis
Adaptive gradient-based optimization methods such as \textsc{Adagrad}, \textsc{Rmsprop}, and \textsc{Adam} are widely used in solving large-scale machine learning problems includin…