Importance of Explicit Vectorization for CPU and GPU Software Performance

Abstract

Much of the current focus in high-performance computing is on multi-threading, multi-computing, and graphics processing unit (GPU) computing. However, vectorization and non-parallel optimization techniques, which can often be employed additionally, are less frequently discussed. In this paper, we present an analysis of several optimizations done on both central processing unit (CPU) and GPU implementations of a particular computationally intensive Metropolis Monte Carlo algorithm. Explicit vectorization on the CPU and the equivalent, explicit memory coalescing, on the GPU are found to be critical to achieving good performance of this algorithm in both environments. The fully-optimized CPU version achieves a 9x to 12x speedup over the original CPU version, in addition to speedup from multi-threading. This is 2x faster than the fully-optimized GPU version.

17 pages, 17 figures

References in corpus (2)

• Robust Parameter Selection for Parallel Tempering
• High-Performance Physics Simulations Using Multi-Core CPUs and GPGPUs in a Volunteer Computing Context

Cited by in corpus (5)

• Efficient Spherical Harmonic Transforms aimed at pseudo-spectral numerical simulations
• Performance potential for simulating spin models on GPU
• Simulating spin models on GPU
• Optimization strategies for parallel CPU and GPU implementations of a meshfree particle method
• Report: GPU Based Massive Parallel Kawasaki Kinetics In Monte Carlo Modelling of Lipid Microdomains