4 citations · 4 across the 2 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
ELSAA: Efficient Low-Rank and Sparse Attention Approximation for Training Transformers
Mahdi Heidari, Mohammad Mahdi Rahimi, Jaekyun Moon
The quadratic attention score matrix remains a central obstacle to extending Transformers to longer input lengths. Existing efficient attention methods usually reduce t…
cs.LG2023★ 4 cited
EvoFed: Leveraging Evolutionary Strategies for Communication-Efficient Federated Learning
Mohammad Mahdi Rahimi, Hasnain Irshad Bhatti, Younghyun Park +2
Federated Learning (FL) is a decentralized machine learning paradigm that enables collaborative model training across dispersed nodes without having to force individual nodes to sh…