24 citations · 157 across the 32 of their papers we have counts for
3 papers · 1 filter
Localized LoRA-MoE: Block-wise Low-Rank Experts With Adaptive Routing
Babak Barazandeh, Subhabrata Majumdar, Vinay Prithyani +1
Large Language Models (LLMs) and high-dimensional perception networks increasingly rely on parameter-efficient fine-tuning (PEFT) to adapt to diverse operational contexts. However,…
Stochastic Regret Guarantees for Online Zeroth- and First-Order Bilevel Optimization
Parvin Nazari, Bojian Hou, Davoud Ataee Tarzanagh +2
Online bilevel optimization (OBO) is a powerful framework for machine learning problems where both outer and inner objectives evolve over time, requiring dynamic updates. Current O…
DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization
Parvin Nazari, Davoud Ataee Tarzanagh, George Michailidis
Adaptive gradient-based optimization methods such as \textsc{Adagrad}, \textsc{Rmsprop}, and \textsc{Adam} are widely used in solving large-scale machine learning problems includin…