126 citations · 281 across the 27 of their papers we have counts for
4 papers · 1 filter
TERRA-NG v1.0: Extreme-Scale, GPU-accelerated Mantle Convection
Fabian Böhm, Nils Kohl, Ponsuganth Ilangovan +7
We present TERRA-NG, a portable, GPU-accelerated, matrix-free mantle-convection code. A single Kokkos C++ implementation runs at scale on NVIDIA, AMD, and Intel GPU supercomputers.…
Performance Analysis of Low-Order, GPU-accelerated Finite Element Kernels using Kokkos
Fabian Böhm, Nils Kohl, Harald Köstler +1
We study performance portability for low-order, matrix-free finite element kernels, using the example of a vectorial, variable-coefficient PDE operator originating in geophysical m…
Move the Query, Not the Cache: Characterizing Cross-Instance Latent Attention Redistribution Across GPU Fabrics
Bole Ma, Jan Eitzinger, Harald Köstler +1
Frontier LLMs increasingly decide what a query attends to with a sparse-attention indexer that picks a few KV-cache blocks per query: attention's unit is now a small, reusable chun…
Diagnosing Overhead in Dispatch Operations: Cross-architecture Observatory
Bole Ma, Jan Eitzinger, Harald Koestler +1
AlltoAll dispatch is the dominant bottleneck of MoE expert parallelism, and the interconnect community has responded with four families of mitigations: predictive sample placement,…