activity
20242026
most citedFAST: Factorizable Attention for Speeding up Transformers

2 citations · 2 across the 9 of their papers we have counts for

collaborators

9 papers

cs.AI2026

Same Question, Different Answers: Evaluating LLM Reliability Beyond Accuracy

Kazem Faghih, Yize Cheng, Shoumik Saha +3

Large language models (LLMs) often achieve strong accuracy on benchmarks, yet it remains unclear how reliably they apply this knowledge when the same question is phrased in differe…

cs.CV2026

On The Application of Linear Attention in Multimodal Transformers

Armin Gerami, Seyedehanita Madani, Ramani Duraiswami

Multimodal Transformers serve as the backbone for state-of-the-art vision-language models, yet their quadratic attention complexity remains a critical barrier to scalability. In th…

cs.IR2026

Quantifying Document Impact in RAG-LLMs

Armin Gerami, Kazem Faghih, Ramani Duraiswami

Retrieval Augmented Generation (RAG) enhances Large Language Models (LLMs) by connecting them to external knowledge, improving accuracy and reducing outdated information. However,…

cs.LG2025

Auditing Algorithmic Bias in Transformer-Based Trading

Armin Gerami, Ramani Duraiswami

Transformer models have become increasingly popular in financial applications, yet their potential risk making and biases remain under-explored. The purpose of this work is to audi…

cs.LG2025

Transformer Based Linear Attention with Optimized GPU Kernel Implementation

Armin Gerami, Ramani Duraiswami

The original softmax-based attention mechanism (regular attention) in the extremely successful Transformer architecture computes attention between tokens, each embedded in a $D…

eess.SP2025

A Scalable MVDR Beamforming Algorithm That is Linear in the Number of Antennas

Sanjaya Herath, Armin Gerami, Kevin Wagner +2

The Minimum Variance Distortionless Response (MVDR) beamforming technique is widely applied in array systems to mitigate interference. However, applying MVDR to large arrays is com…

eess.AS2025

Room Impulse Response Synthesis via Differentiable Feedback Delay Networks for Efficient Spatial Audio Rendering

Armin Gerami, Ramani Duraiswami

We introduce a computationally efficient and tunable feedback delay network (FDN) architecture for real-time room impulse response (RIR) rendering that addresses the computational…

cs.AR2024

GUST: Graph Edge-Coloring Utilization for Accelerating Sparse Matrix Vector Multiplication

Armin Gerami, Bahar Asgari

Sparse matrix-vector multiplication (SpMV) plays a vital role in various scientific and engineering fields, from scientific computing to machine learning. Traditional general-purpo…

cs.LG2024★ 2 cited

FAST: Factorizable Attention for Speeding up Transformers

Armin Gerami, Monte Hoover, Pranav S. Dulepet +1

Motivated by the factorization inherent in the original fast multipole method and the improved fast Gauss transform we introduce a factorable form of attention that operates effici…