2 citations · 2 across the 1 of their papers we have counts for
3 papers
Demystifying the Communication Characteristics for Distributed Transformer Models
Quentin Anthony, Benjamin Michalowicz, Jacob Hatef +5
Deep learning (DL) models based on the transformer architecture have revolutionized many DL applications such as large language models (LLMs), vision transformers, audio generation…
An Adaptive Performance-oriented Scheduler for Static and Dynamic Heterogeneity
Jing Chen, Pirah Noor Soomro, Mustafa Abduljabbar +1
With the emergence of heterogeneous hardware paving the way for the post-Moore era, it is of high importance to adapt the runtime scheduling to the platform's heterogeneity. To enh…
Communication Reducing Algorithms for Distributed Hierarchical N-Body Problems with Boundary Distributions
Mustafa Abduljabbar, George Markomanolis, Huda Ibeid +2
Reduction of communication and efficient partitioning are key issues for achieving scalability in hierarchical -Body algorithms like FMM. In the present work, we propose four in…