10 citations · 35 across the 23 of their papers we have counts for
31 papers
HPCAgent-Bench: A Framework for Sound Benchmarking of Code-Optimizing Agents, Harnesses, and Skills
Yakup Koray Budanaz, Lorenzo Paleari, Marcin Copik +7
Coding agents are increasingly used to optimize code, but existing benchmarks fix one accelerator, programming model or harness, so they cannot isolate what each component contribu…
What Bloats Your Floats? Right-Sizing Numerical Precision for Scientific Computing
Pratyai Mazumder, Alexandru Calotoiu, Marcin Copik +3
While FP64 (binary64) remains the standard representation of real numbers in scientific computing, hardware trends increasingly favor low-precision formats optimized for AI workloa…
FP64 Is All You Want, INT8 Is All You Need, FP4/6/8 Is All You Have
Pratyai Mazumder, Alexandru Calotoiu, Torsten Hoefler
Ozaki scheme II emulates FP64 matrix products with INT8 ones through residues modulo pairwise coprime moduli, and variants for FP8 and FP4 have followed. We treat these schemes as…
Mixed-Precision Computing for Scientific Discovery: Formats, Co-Design, and Responsible Approximation
Emmanuel Agullo, Hartwig Anzt, Daniel Bauer +37
Reduced and mixed precision have moved from a niche optimization to a central design axis in scientific computing and engineering, driven by energy constraints, heterogeneous accel…
Hardware-Aware Features for CUTLASS Kernel Selection
Shriram Chandran, Dominic Rinderer, Yakup Budanaz +3
GPU libraries such as CUTLASS expose tens of thousands of semantically equivalent kernels for a single operation, making exhaustive autotuning expensive and execution-free selectio…
Gauss What You Need: Compact Gaussian Splatting Across Scene Scales
Afif Boudaoud, Jiayi Liu, Alexandru Calotoiu +1
3D Gaussian Splatting reconstructs a scene as a collection of Gaussian primitives from a set of posed photographs called the capture. The number of primitives used to represent the…
The Canonical Parallel Form as a Substrate for Parallelizing Compilers and Agentic Optimizers
Yakup Koray Budanaz, Pratyai Mazumder, Alexandru Calotoiu +1
Imperative code fixes an execution order the computation does not require, and a parallelizing compiler must prove which parts of that order it can remove. We introduce the Canonic…
ADELIA: Automatic Differentiation for Efficient Laplace Inference Approximations
Afif Boudaoud, Lisa Gaedke-Merzhäuser, Alexandros Nikolaos Ziogas +6
Spatio-temporal Bayesian inference drives environmental and health sciences using latent Gaussian models. Integrated Nested Laplace Approximations (INLA) enable inference for these…
Scaling Laws of Global Weather Models
Yuejiang Yu, Langwen Huang, Alexandru Calotoiu +1
Data-driven models are revolutionizing weather forecasting. To optimize training efficiency and model performance, this paper analyzes empirical scaling laws within this domain. We…
MLIR-Forge: A Modular Framework for Language Smiths
Berke Ates, Philipp Schaad, Timo Schneider +2
Optimizing compilers are essential for the efficient and correct execution of software across various scientific fields. Domain-specific languages (DSL) typically use higher level…
Design in Tiles: Automating GEMM Deployment on Tile-Based Many-PE Accelerators
Aofeng Shen, Chi Zhang, Yakup Budanaz +4
Tile-based many-Processing Element (PE) accelerators can achieve competitive performance on General Matrix Multiplication (GEMM), but they are extremely hard to program, as their o…
Computing the Full Earth System at 1 km Resolution
Daniel Klocke, Claudia Frauen, Jan Frederik Engels +24
We present the first-ever global simulation of the full Earth system at 1.25 km grid spacing, achieving highest time compression with an unseen number of degrees of freedom. Our mo…
DaCe AD: Unifying High-Performance Automatic Differentiation for Machine Learning and Scientific Computing
Afif Boudaoud, Alexandru Calotoiu, Marcin Copik +1
Automatic differentiation (AD) is a set of techniques that systematically applies the chain rule to compute the gradients of functions without requiring human intervention. Althoug…
Denoising Application Performance Models with Noise-Resilient Priors
Gustavo de Morais, Alexander Geiß, Alexandru Calotoiu +5
As parallel codes are scaled to larger computing systems, performance models play a crucial role in identifying potential bottlenecks. However, constructing these models analytical…
Iterating Pointers: Enabling Static Analysis for Loop-based Pointers
Andrea Lepori, Alexandru Calotoiu, Torsten Hoefler
Pointers are an integral part of C and other programming languages. They enable substantial flexibility from the programmer's standpoint, allowing the user fine, unmediated control…
A Priori Loop Nest Normalization: Automatic Loop Scheduling in Complex Applications
Lukas Trümper, Philipp Schaad, Berke Ates +3
The same computations are often expressed differently across software projects and programming languages. In particular, how computations involving loops are expressed varies due t…
SeBS-Flow: Benchmarking Serverless Cloud Function Workflows
Larissa Schmid, Marcin Copik, Alexandru Calotoiu +3
Serverless computing has emerged as a prominent paradigm, with a significant adoption rate among cloud customers. While this model offers advantages such as abstraction from the de…
Towards Specialized Supercomputers for Climate Sciences: Computational Requirements of the Icosahedral Nonhydrostatic Weather and Climate Model
Torsten Hoefler, Alexandru Calotoiu, Anurag Dipankar +3
We discuss the computational challenges and requirements for high-resolution climate simulations using the Icosahedral Nonhydrostatic Weather and Climate Model (ICON). We define a…
Software Resource Disaggregation for HPC with Serverless Computing
Marcin Copik, Marcin Chrapek, Larissa Schmid +2
Aggregated HPC resources have rigid allocation systems and programming models which struggle to adapt to diverse and changing workloads. Consequently, HPC systems fail to efficient…
Cppless: Single-Source and High-Performance Serverless Programming in C++
Marcin Copik, Lukas Möller, Alexandru Calotoiu +1
The rise of serverless computing introduced a new class of scalable, elastic and widely available parallel workers in the cloud. Many systems and applications benefit from offloadi…
User-guided Page Merging for Memory Deduplication in Serverless Systems
Wei Qiu, Marcin Copik, Yun Wang +2
Serverless computing is an emerging cloud paradigm that offers an elastic and scalable allocation of computing resources with pay-as-you-go billing. In the Function-as-a-Service (F…
FuzzyFlow: Leveraging Dataflow To Find and Squash Program Optimization Bugs
Philipp Schaad, Timo Schneider, Tal Ben-Nun +3
The current hardware landscape and application scale is driving performance engineers towards writing bespoke optimizations. Verifying such optimizations, and generating minimal fa…
Bridging Control-Centric and Data-Centric Optimization
Tal Ben-Nun, Berke Ates, Alexandru Calotoiu +1
With the rise of specialized hardware and new programming languages, code optimization has shifted its focus towards promoting data locality. Most production-grade compilers adopt…
FMI: Fast and Cheap Message Passing for Serverless Functions
Marcin Copik, Roman Böhringer, Alexandru Calotoiu +1
Serverless functions provide elastic scaling and a fine-grained billing model, making Function-as-a-Service (FaaS) an attractive programming model. However, for distributed jobs th…