GPU acceleration of CaNS for massively-parallel direct numerical simulations of canonical fluid flows

Abstract

This work presents the GPU acceleration of the open-source code CaNS for very fast massively-parallel simulations of canonical fluid flows. The distinct feature of the many-CPU Navier-Stokes solver in CaNS is its fast direct solver for the second-order finite-difference Poisson equation, based on the method of eigenfunction expansions. The solver implements all the boundary conditions valid for this type of problems in a unified framework. Here, we extend the solver for GPU-accelerated clusters using CUDA Fortran. The porting makes extensive use of CUF kernels and has been greatly simplified by the unified memory feature of CUDA Fortran, which handles the data migration between host (CPU) and device (GPU) without defining new arrays in the source code. The overall implementation has been validated against benchmark data for turbulent channel flow and its performance assessed on a NVIDIA DGX-2 system (16 Tesla V100 32Gb, connected with NVLink via NVSwitch). The wall-clock time per time step of the GPU-accelerated implementation is impressively small when compared to its CPU implementation on state-of-the-art many-CPU clusters, as long as the domain partitioning is sufficiently small that the data resides mostly on the GPUs. The implementation has been made freely available and open-source under the terms of an MIT license.

References in corpus (8)

• An Immersed Boundary Method with Direct Forcing for the Simulation of Particulate Flows
• A FFT-based finite-difference solver for massively-parallel direct numerical simulations of turbulent flows
• AFiD-GPU: a versatile Navier-Stokes Solver for Wall-Bounded Turbulent Flows on GPU Clusters
• Recent progress and challenges in exploiting graphics processors in computational fluid dynamics
• Universal Scaling Laws for Dense Particle Suspensions in Turbulent Wall-Bounded Flows
• The near-wall region of highly turbulent Taylor-Couette flow
• PittPack: An Open-Source Poisson's Equation Solver for Extreme-Scale Computing with Accelerators
• A scalable multi-GPU method for semi-implicit fractional-step integration of incompressible Navier-Stokes equations

Cited by in corpus (3)

• FluTAS: A GPU-accelerated finite difference code for multiphase flows
• Drag prediction of rough-wall turbulent flow using data-driven regression
• A FFT-accelerated multi-block finite-difference solver for massively parallel simulations of incompressible flows