Particle-resolved thermal lattice Boltzmann simulation using OpenACC on multi-GPUs

Abstract

We utilize the Open Accelerator (OpenACC) approach for graphics processing unit (GPU) accelerated particle-resolved thermal lattice Boltzmann (LB) simulation. We adopt the momentum-exchange method to calculate fluid-particle interactions to preserve the simplicity of the LB method. To address load imbalance issues, we extend the indirect addressing method to collect fluid-particle link information at each timestep and store indices of fluid-particle link in a fixed index array. We simulate the sedimentation of 4,800 hot particles in cold fluids with a domain size of $4000^2$, and the simulation achieves 1750 million lattice updates per second (MLUPS) on a single GPU. Furthermore, we implement a hybrid OpenACC and message passing interface (MPI) approach for multi-GPU accelerated simulation. This approach incorporates four optimization strategies, including building domain lists, utilizing request-answer communication, overlapping communications with computations, and executing computation tasks concurrently. By reducing data communication between GPUs, hiding communication latency through overlapping computation, and increasing the utilization of GPU resources, we achieve improved performance, reaching 10846 MLUPS using 8 GPUs. Our results demonstrate that the OpenACC-based GPU acceleration is promising for particle-resolved thermal lattice Boltzmann simulation.

arXiv comment46 pages, 18 figures

References in corpus (16)

• Numerical Simulations of Particulate Suspensions via a Discretized Boltzmann Equation Part I. Theoretical Foundation
• Galilean Invariant Fluid-Solid Interfacial Dynamics in Lattice Boltzmann Simulations
• Bubbly and Buoyant Particle-Laden Turbulent Flows
• Extreme flow simulations reveal skeletal adaptations of deep-sea sponges
• Sailfish: a flexible multi-GPU implementation of the lattice Boltzmann method
• Lattice Boltzmann simulations of three-dimensional thermal convective flows at high Rayleigh number
• Recent progress and challenges in exploiting graphics processors in computational fluid dynamics
• A family of single-node second-order boundary schemes for the lattice Boltzmann method
• A combined immersed boundary and discrete unified gas kinetic scheme for particle-fluid flows
• Multi-GPU thermal lattice Boltzmann simulations using OpenACC and MPI
• Settling of inertial particles in turbulent Rayleigh-Benard convection
• Performance and Portability of Accelerated Lattice Boltzmann Applications with OpenACC
• Tristable flow states and reversal of the large-scale circulation in two-dimensional circular convection cells
• Wall-sheared thermal convection: heat transfer enhancement and turbulence relaminarization
• Accelerating CFD simulation with high order finite difference method on curvilinear coordinates for modern GPU clusters
• Lightweight Lattice Boltzmann

Cited by in corpus (4)

• Accelerating Particle-in-Cell Monte Carlo Simulations with MPI, OpenMP/OpenACC and Asynchronous Multi-GPU Programming
• Super-resolution reconstruction of turbulent flows from a single Lagrangian trajectory
• Interpolation-supplemented lattice Boltzmann simulation of thermal convection on non-uniform meshes
• GPU-native Embedding of Complex Geometries in Adaptive Octree Grids Applied to the Lattice Boltzmann Method