3 papers
cs.DC2026
Configurable and Hierarchical Allreduce
Valentino Guerrini, Ke Fan, Sidharth Kumar
MPI_Allreduce is among the most performance-critical collectives in large-scale scientific computing and distributed machine learning, yet the small- and medium-message regime rema…
cs.AI2026
EGG: An Expert-Guided Agent Framework for Kernel Generation
Yaochen Han, Ke Fan, Hongxu Jiang +5
High-performance GPU kernels are critical for reducing the exponentially growing computational costs of large language models (LLMs), but their development heavily relies on manual…
cs.DC2024
Configurable Non-uniform All-to-all Algorithms
Ke Fan, Jens Domke, Seydou Ba +1
MPI_Alltoallv generalizes the uniform all-to-all communication (MPI_Alltoall) by enabling the exchange of data blocks of varied sizes among processes. This function plays a crucial…