92 citations · 237 across the 29 of their papers we have counts for
8 papers · 1 filter
DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang +89
In the upcoming decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences. This could herald a new era of scient…
A Comprehensive Performance Study of Large Language Models on Novel AI Accelerators
Murali Emani, Sam Foreman, Varuni Sastry +6
Artificial intelligence (AI) methods have become critical in scientific applications to help accelerate scientific discovery. Large language models (LLMs) are being considered as a…
HPC-GPT: Integrating Large Language Model for High-Performance Computing
Xianzhong Ding, Le Chen, Murali Emani +6
Large Language Models (LLMs), including the LLaMA model, have exhibited their efficacy across various general-domain natural language processing (NLP) tasks. However, their perform…
Data Race Detection Using Large Language Models
Le Chen, Xianzhong Ding, Murali Emani +3
Large language models (LLMs) are demonstrating significant promise as an alternate strategy to facilitate analyses and optimizations of high-performance computing programs, circumv…
A Survey of Techniques for Optimizing Transformer Inference
Krishna Teja Chitty-Venkata, Sparsh Mittal, Murali Emani +2
Recent years have seen a phenomenal rise in performance and applications of transformer neural networks. The family of transformer networks, including Bidirectional Encoder Represe…
LM4HPC: Towards Effective Language Model Application in High-Performance Computing
Le Chen, Pei-Hung Lin, Tristan Vanderbruggen +3
In recent years, language models (LMs), such as GPT-4, have been widely used in multiple domains, including natural language processing, visualization, and so on. However, applying…
A Multi-Level, Multi-Scale Visual Analytics Approach to Assessment of Multifidelity HPC Systems
Shilpika, Bethany Lusch, Murali Emani +4
The ability to monitor and interpret of hardware system events and behaviors are crucial to improving the robustness and reliability of these systems, especially in a supercomputin…
Transfer Learning Across Heterogeneous Features For Efficient Tensor Program Generation
Gaurav Verma, Siddhisanket Raskar, Zhen Xie +3
Tuning tensor program generation involves searching for various possible program transformation combinations for a given program on target hardware to optimize the tensor program e…