Leveraging AI for Productive and Trustworthy HPC Software: Challenges and Research Directions

Abstract

We discuss the challenges and propose research directions for using AI to revolutionize the development of high-performance computing (HPC) software. AI technologies, in particular large language models, have transformed every aspect of software development. For its part, HPC software is recognized as a highly specialized scientific field of its own. We discuss the challenges associated with leveraging state-of-the-art AI technologies to develop such a unique and niche class of software and outline our research directions in the two US Department of Energy--funded projects for advancing HPC Software via AI: Ellora and Durban.

12 pages, 1 Figure, Accepted at "The 1st International Workshop on Foundational Large Language Models Advances for HPC" LLM4HPC to be held in conjunction with ISC High Performance 2025

References in corpus (6)

• Automatic Generation of Programming Exercises and Code Explanations using Large Language Models
• HPC-Coder: Modeling Parallel Programs using Large Language Models
• Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generation
• Can Large Language Models Write Parallel Code?
• The State of Fortran
• CodeRosetta: Pushing the Boundaries of Unsupervised Code Translation for Parallel Programming