79 citations · 276 across the 27 of their papers we have counts for
32 papers
Manifold Projection and Iterative Autoencoder Refinement for Masked Language Modeling
Narges Mokhtari, Farzan Haddadi, Ebrahim Rezaii
In Transformer-based masked language models, attention is the primary mechanism for context mixing, but there are other ways to mix data across tokens. Recent attention-free mixers…
Denoising Diffusion Generative Models Secretly Calculate Attentions
Farzan Haddadi, Leila Monfared, Ebrahim Rezaii +3
Denoising diffusion models are the dominant architecture for image generation, whereas most natural language generation and modeling are primarily handled by well-known transformer…
Hybrid Quantum-Classical Selective State Space Artificial Intelligence
Amin Ebrahimi, Farzan Haddadi
Hybrid Quantum Classical (HQC) algorithms constitute one of the most effective paradigms for exploiting the computational advantages of quantum systems in large-scale numerical tas…
L2T-Hyena: Enhancing State-Space Models with an Adaptive Learn-to-Teach Framework
Fatemeh Sohbati, Farzan Haddadi, Hamid Salahinejad
State-space models (SSMs) have recently emerged as efficient alternatives to computationally intensive architectures such as Transformers for sequence modeling. However, their trai…
Matrix Completion via Nonsmooth Regularization of Fully Connected Neural Networks
Sajad Faramarzi, Farzan Haddadi, Sajjad Amini +2
Conventional matrix completion methods approximate the missing values by assuming the matrix to be low-rank, which leads to a linear approximation of missing values. It has been sh…
Blind Two-Dimensional Super Resolution in Multiple Input Single Output Linear Systems
Shahedeh Sayyari, Sajad Daei, Farzan Haddadi
In this paper, we consider a multiple-input single-output (MISO) linear time-varying system whose output is a superposition of scaled and time-frequency shifted versions of inputs.…