Scaling of a Fast Fourier Transform and a Pseudo-spectral Fluid Solver up to 196608 cores

Abstract

In this paper we present scaling results of a FFT library, FFTK, and a pseudospectral code, Tarang, on grid resolutions up to $8192^3$ grid using 65536 cores of Blue Gene/P and 196608 cores of Cray XC40 supercomputers. We observe that communication dominates computation, more so on the Cray XC40. The computation time scales as $T_{\mathrm{comp}}\sim p^{-1}$, and the communication time as $T_{\mathrm{comm}}\sim n^{-{\gamma }_2}$ with ${\gamma }_2$ ranging from 0.7 to 0.9 for Blue Gene/P, and from 0.43 to 0.73 for Cray XC40. FFTK, and the fluid and convection solvers of Tarang exhibit weak as well as strong scaling nearly up to 196608 cores of Cray XC40. We perform a comparative study of the performance on the Blue Gene/P and Cray XC40 clusters.

References in corpus (14)

• Statistical Theory of Magnetohydrodynamic Turbulence: Recent Results
• P3DFFT: a framework for parallel computations of Fourier transforms in three dimensions
• Phenomenology of buoyancy-driven turbulence: recent results
• Benchmarking and scaling studies of a pseudospectral code Tarang for turbulence simulations
• Energy Spectrum of Buoyancy-Driven Turbulence
• Statistical equilibria of large scales in dissipative hydrodynamic turbulence
• Scaling of heat flux and energy spectrum for "very large" Prandtl number convection
• Strong anisotropy in quasi-static magnetohydrodynamic turbulence for high interaction parameters
• Evidence for Bolgiano-Obukhov scaling in rotating stratified turbulence using high-resolution direct numerical simulations
• Near isotropic behaviour of turbulent thermal convection
• Energy transfers and magnetic energy growth in small-scale dynamo
• Flow reversals in turbulent convection with free-slip walls
• Field correlations and the ultimate regime of turbulent convection
• Oscillatory instability and fluid patterns in low-Prandtl-number Rayleigh-Bénard convection with uniform rotation

Cited by in corpus (17)

• On the energy spectrum of rapidly rotating forced turbulence
• Applicability of Taylor's hypothesis in thermally driven turbulence
• Statistical features of rapidly rotating decaying turbulence: enstrophy and energy spectra, and coherent structures
• Energy and enstrophy spectra and fluxes for the inertial-dissipation range of two-dimensional turbulence
• Surface Ocean Enstrophy, Kinetic Energy Fluxes and Spectra from Satellite Altimetry
• Large eddy simulations of turbulent thermal convection using renormalized viscosity and thermal diffusivity
• Prandtl number dependence of the small-scale properties in turbulent Rayleigh-Bénard convection
• FLUPS: a Fourier-based Library of Unbounded Poisson Solvers
• An Efficient Particle Tracking Algorithm for Large-Scale Parallel Pseudo-Spectral Simulations of Turbulence
• Bridging Inertial and Dissipation Range Statistics in Rotating Turbulence
• Enstrophy transfers in helical turbulence
• Similarities between the structure functions of thermal convection and hydrodynamic turbulence
• Dynamic Phase Alignment in Navier-Stokes Turbulence
• Turbulence in a stably stratified fluid: Onset of global anisotropy as a function of the Richardson number
• Cross helicity sign reversals in the dissipative scales of magnetohydrodynamic turbulence
• Scalability of 3D-DFT by block tensor-matrix multiplication on the JUWELS Cluster
• Sweeping effect and Taylor's hypothesis via correlation function