High level implementation of geometric multigrid solvers for finite element problems: applications in atmospheric modelling

Abstract

The implementation of efficient multigrid preconditioners for elliptic partial differential equations (PDEs) is a challenge due to the complexity of the resulting algorithms and corresponding computer code. For sophisticated finite element discretisations on unstructured grids an efficient implementation can be very time consuming and requires the programmer to have in-depth knowledge of the mathematical theory, parallel computing and optimisation techniques on manycore CPUs. In this paper we show how the development of bespoke multigrid preconditioners can be simplified significantly by using a framework which allows the expression of the each component of the algorithm at the correct abstraction level. Our approach (1) allows the expression of the finite element problem in a language which is close to the mathematical formulation of the problem, (2) guarantees the automatic generation and efficient execution of parallel optimised low-level computer code and (3) is flexible enough to support different abstraction levels and give the programmer control over details of the preconditioner. We use the composable abstractions of the Firedrake/PyOP2 package to demonstrate the efficiency of this approach for the solution of strongly anisotropic PDEs in atmospheric modelling. The weak formulation of the PDE is expressed in Unified Form Language (UFL) and the lower PyOP2 abstraction layer allows the manual design of computational kernels for a bespoke geometric multigrid preconditioner. We compare the performance of this preconditioner to a single-level method and hypre's BoomerAMG algorithm. The Firedrake/PyOP2 code is inherently parallel and we present a detailed performance analysis for a single node (24 cores) on the ARCHER supercomputer. Our implementation utilises a significant fraction of the available memory bandwidth and shows very good weak scaling on up to 6,144 compute cores.

22 pages, 5 figures, 9 tables. Submitted to JCP

References in corpus (2)

• Firedrake: automating the finite element method by composing abstractions
• Multigrid methods for Hdiv-conforming discontinuous Galerkin methods for the Stokes equations

Cited by in corpus (7)

• LFRic: Meeting the challenges of scalability and performance portability in Weather and Climate models
• The evolution of superluminous supernova LSQ14mo and its interacting host galaxy system
• Multigrid preconditioners for the mixed finite element dynamical core of the LFRic atmospheric model
• Slate: extending Firedrake's domain-specific abstraction to hybridized solvers for geoscience and beyond
• A scalable DG solver for the electroneutral Nernst-Planck equations
• Robust and efficient primal-dual Newton-Krylov solvers for viscous-plastic sea-ice models
• Multigrid preconditioners for the hybridized Discontinuous Galerkin discretisation of the shallow water equations