2 citations · 3 across the 4 of their papers we have counts for
4 papers
Demystifying the Communication Characteristics for Distributed Transformer Models
Quentin Anthony, Benjamin Michalowicz, Jacob Hatef +5
Deep learning (DL) models based on the transformer architecture have revolutionized many DL applications such as large language models (LLMs), vision transformers, audio generation…
An Adaptive Performance-oriented Scheduler for Static and Dynamic Heterogeneity
Jing Chen, Pirah Noor Soomro, Mustafa Abduljabbar +1
With the emergence of heterogeneous hardware paving the way for the post-Moore era, it is of high importance to adapt the runtime scheduling to the platform's heterogeneity. To enh…
Extreme Scale FMM-Accelerated Boundary Integral Equation Solver for Wave Scattering
Mustafa Abduljabbar, Mohammed Al Farhan, Noha Al-Harthi +4
Algorithmic and architecture-oriented optimizations are essential for achieving performance worthy of anticipated energy-austere exascale systems. In this paper, we present an extr…
Communication Reducing Algorithms for Distributed Hierarchical N-Body Problems with Boundary Distributions
Mustafa Abduljabbar, George Markomanolis, Huda Ibeid +2
Reduction of communication and efficient partitioning are key issues for achieving scalability in hierarchical -Body algorithms like FMM. In the present work, we propose four in…