DFT-FE -- A massively parallel adaptive finite-element code for large-scale density functional theory calculations

Abstract

We present an accurate, efficient and massively parallel finite-element code, DFT-FE, for large-scale ab-initio calculations (reaching $\sim 100,000$ electrons) using Kohn-Sham density functional theory (DFT). DFT-FE is based on a local real-space variational formulation of the Kohn-Sham DFT energy functional that is discretized using a higher-order adaptive spectral finite-element (FE) basis, and treats pseudopotential and all-electron calculations in the same framework, while accommodating non-periodic, semi-periodic and periodic boundary conditions. We discuss the main aspects of the code, which include, the various strategies of adaptive FE basis generation, and the different approaches employed in the numerical implementation of the solution of the discrete Kohn-Sham problem that are focused on significantly reducing the floating point operations, communication costs and latency. We demonstrate the accuracy of DFT-FE by comparing the energies, ionic forces and periodic cell stresses on a wide range of problems with popularly used DFT codes. Further, we demonstrate that DFT-FE significantly outperforms widely used plane-wave codes---both in CPU-times and wall-times, and on both non-periodic and periodic systems---at systems sizes beyond a few thousand electrons, with over $5-10$ fold speedups in systems with more than 10,000 electrons. The benchmark studies also highlight the excellent parallel scalability of DFT-FE, with strong scaling demonstrated on up to 192,000 MPI tasks.

57 pages, 14 figures

References in corpus (28)

• Quantum ESPRESSO: a modular and open-source software project for quantum simulations of materials
• Advanced capabilities for materials modelling with Quantum ESPRESSO
• Optimized norm-conserving Vanderbilt pseudopotentials
• Optimization Algorithm for the Generation of ONCV Pseudopotentials
• O(N) methods in electronic structure calculations
• Real-space grids and the Octopus code as tools for the development of new simulation approaches for electronic systems
• Daubechies wavelets as a basis set for density functional pseudopotential calculations
• Ab Initio Study of Screw Dislocations in Mo and Ta: A new picture of plasticity in bcc transition metals
• Parallel Self-Consistent-Field Calculations via Chebyshev-Filtered Subspace Acceleration
• Dislocation Core Energies and Core Fields from First Principles
• Higher-order adaptive finite-element methods for Kohn-Sham density functional theory
• SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Extended systems
• RESCU: a Real Space Electronic Structure Method
• From Electrons to Finite Elements: A Concurrent Multiscale Approach for Metals
• Multiscale simulations in simple metals: a density-functional based methodology
• Real-space local polynomial basis for solid-state electronic-structure calculations: A finite-element approach
• SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Isolated clusters
• DGDFT: A Massively Parallel Method for Large Scale Density Functional Theory Calculations
• All-electron density functional theory and time-dependent density functional theory with high-order finite elements
• Large-scale all-electron density functional theory calculations using an enriched finite element basis
• A subquadratic-scaling subspace projection method for large-scale Kohn-Sham density functional theory calculations using spectral finite-element discretization
• Linear scaling DFT calculations for large Tungsten systems using an optimized local basis
• Electronic-structure study of an edge dislocation in Aluminum and the role of macroscopic deformations on its energetics
• Configurational forces in electronic structure calculations using Kohn-Sham density functional theory
• Applicability of Kerker preconditioning scheme to the self-consistent density functional theory calculations of inhomogeneous systems
• Electronic structure study of screw dislocation core energetics in Aluminum and core energetics informed forces in a dislocation aggregate
• Orbital-free DFT study of the energetics of vacancy clustering and prismatic dislocation loop nucleation in aluminum
• Spectrum-splitting approach for Fermi-operator expansion in all-electron Kohn-Sham DFT calculations

Cited by in corpus (33)

• The deal.II finite element library: design, features, and insights
• Roadmap on Electronic Structure Codes in the Exascale Era
• DFT-FE 1.0: A massively parallel hybrid CPU-GPU density functional theory code using finite-element discretization
• Towards Electronic Structure-Based Ab-Initio Molecular Dynamics Simulations with Hundreds of Millions of Atoms
• Transversal flexoelectric coefficient for nanostructures at finite deformations from first principles
• On preconditioning the self-consistent field iteration in real-space Density Functional Theory
• Real-time time-dependent density functional theory using higher order finite element methods
• Fast and robust all-electron density functional theory calculations in solids using orthogonalized enriched finite elements
• Torsional strain engineering of transition metal dichalcogenide nanotubes: An ab initio study
• Nonequilibrium thermomechanics of Gaussian phase packet crystals: application to the quasistatic quasicontinuum method
• MiMiC: A High-Performance Framework for Multiscale Molecular Dynamics Simulations
• Large scale ab-initio simulations of dislocations
• Exact and model exchange-correlation potentials for open-shell systems
• Torsional moduli of transition metal dichalcogenide nanotubes from first principles
• Quasicrystal bulk and surface energies from density functional theory
• Solving the electronic structure problem for over 100,000 atoms in real-space
• Band structures and ${\mathbb{Z}}_2$ invariants of two-dimensional transition metal dichalcogenide monolayers from fully-relativistic Dirac-Kohn-Sham theory using Gaussian-type orbitals
• Accelerating self-consistent field iterations in Kohn-Sham density functional theory using a low rank approximation of the dielectric matrix
• Automated atomistic simulations of dissociated dislocations with ab initio accuracy
• Treecode-accelerated Green Iteration for Kohn-Sham Density Functional Theory
• SPARC: Simulation Package for Ab-initio Real-space Calculations
• Ionic forces and stress tensor in all-electron DFT calculations using enriched finite element basis
• Subspace recursive Fermi-operator expansion strategies for large-scale DFT eigenvalue problems on HPC architectures
• Shifting sands of hardware and software in exascale quantum mechanical simulations
• Three Practical Workflow Schedulers for Easy Maximum Parallelism
• Fast hardware-aware matrix-free algorithm for higher-order finite-element discretized matrix multivector products on distributed systems
• Direct minimization on the complex Stiefel manifold in Kohn-Sham density functional theory for finite and extended systems
• On the Efficient Evaluation of the Exchange Correlation Potential on Graphics Processing Unit Clusters
• Chemical bonding in large systems using projected population analysis from real-space density functional theory calculations
• Finite-element methods for noncollinear magnetism and spin-orbit coupling in real-space pseudopotential density functional theory
• Tensor-structured algorithm for reduced-order scaling large-scale Kohn-Sham density functional theory calculations
• eminus -- Pythonic electronic structure theory
• Spin-spin interactions in solids from mixed all-electron and pseudopotential calculations $-$ a path to screening materials for spin qubits