Large scale ab initio calculations based on three levels of parallelization

Abstract

We suggest and implement a parallelization scheme based on an efficient multiband eigenvalue solver, called the locally optimal block preconditioned conjugate gradient LOBPCG method, and using an optimized three-dimensional (3D) fast Fourier transform (FFT) in the ab initio}plane-wave code ABINIT. In addition to the standard data partitioning over processors corresponding to different k-points, we introduce data partitioning with respect to blocks of bands as well as spatial partitioning in the Fourier space of coefficients over the plane waves basis set used in ABINIT. This k-points-multiband-FFT parallelization avoids any collective communications on the whole set of processors relying instead on one-dimensional communications only. For a single k-point, super-linear scaling is achieved for up to 100 processors due to an extensive use of hardware optimized BLAS, LAPACK, and SCALAPACK routines, mainly in the LOBPCG routine. We observe good performance up to 200 processors. With 10 k-points our three-way data partitioning results in linear scaling up to 1000 processors for a practical system used for testing.

8 pages, 5 figures. Accepted to Computational Material Science

References in corpus (1)

• Parallel Self-Consistent-Field Calculations via Chebyshev-Filtered Subspace Acceleration

Cited by in corpus (37)

• Chiral phonons probed by X rays
• SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Extended systems
• RESCU: a Real Space Electronic Structure Method
• SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Isolated clusters
• Ab initio model of optical properties of two-temperature warm dense matter
• Roadmap on Electronic Structure Codes in the Exascale Era
• Fast and Universal Kohn Sham Density Functional Theory Algorithm for Warm Dense Matter to Hot Dense Plasma
• The melting curve of iron at extreme pressures: implications for planetary cores
• A Projected Preconditioned Conjugate Gradient Algorithm for Computing Many Extreme Eigenpairs of a Hermitian Matrix
• Enhancement of DFT-calculations at Petascale: Nuclear Magnetic Resonance, Hybrid Density Functional Theory and Car-Parrinello calculations
• Conducting boron sheets formed by the reconstruction of the α-boron (111) surface
• Lattice dynamics and ultrafast energy flow between electrons, spins, and phonons in a 3d ferromagnet
• Chebyshev polynomial filtered subspace iteration in the Discontinuous Galerkin method for large-scale electronic structure calculations
• Strong Isotopic Effect in Phase II of Dense Solid Hydrogen and Deuterium
• Ab Initio Simulations of Dense Helium Plasmas
• Parallel eigensolvers in plane-wave Density Functional Theory
• A spectral scheme for Kohn-Sham density functional theory of clusters
• Statistical investigations on nitrogen-vacancy center creation
• Origins of anisotropic thermal expansion in flexible materials
• Abinit 2025: New Capabilities for the Predictive Modeling of Solids and Nanomaterials
• Efficient dielectric matrix calculations using the Lanczos algorithm for fast many-body $G_0{W}_0$ implementations
• Non-parametric Local Pseudopotentials with Machine Learning: a Tin Pseudopotential Built Using Gaussian Process Regression
• Understanding XANES spectra of two-temperature warm dense copper using ab initio simulation
• Anomalous thermal expansion and chiral phonons in BiB${}_3$O${}_6$
• Reconciling ionization energies and band gaps of warm dense matter derived with ab initio simulations and average atom models
• Intrinsic energy flow in laser-excited 3$d$ ferromagnets
• Hybrid preconditioning for iterative diagonalization of ill-conditioned generalized eigenvalue problems in electronic structure calculations
• Chiral phonons as dark matter detectors
• Prediction of a novel monoclinic carbon allotrope
• Convergence theory for preconditioned eigenvalue solvers in a nutshell
• Performance analysis of electronic structure codes on HPC systems: A case study of SIESTA
• Investigating Mechanisms of State Localization in Highly-Ionized Dense Plasmas
• Ab initio Canonical Sampling based on Variational Inference
• Continuum-atomistic simulation of picosecond laser heating of copper with electron heat capacity from ab initio calculation
• Boron and nitrogen doping in graphene antidot lattices
• Efficient iterative method for solving the Dirac-Kohn-Sham density functional theory
• Theoretical study on the variation of ordering vector in Ce(Pd${}_{1-x}$M${}_x$)${}_2$Al${}_3$ (M$=${Ag, Cu})