107 citations · 129 across the 5 of their papers we have counts for
5 papers
Nemotron-4 340B Technical Report
Nvidia, :, Bo Adler +80
We release the Nemotron-4 340B model family, including Nemotron-4-340B-Base, Nemotron-4-340B-Instruct, and Nemotron-4-340B-Reward. Our models are open access under the NVIDIA Open…
Bring the BitCODE -- Moving Compute and Data in Distributed Heterogeneous Systems
Wenbin Lu, Luis E. Peña, Pavel Shamis +3
In this paper, we present a framework for moving compute and data between processing elements in a distributed heterogeneous system. The implementation of the framework is based on…
UCX Programming Interface for Remote Function Injection and Invocation
Luis E. Peña, Wenbin Lu, Pavel Shamis +1
Network library APIs have historically been developed with the emphasis on data movement, placement, and communication semantics. Many communication semantics are available across…
Two-Chains: High Performance Framework for Function Injection and Execution
Megan Grodowitz, Luis E. Peña, Curtis Dunham +3
Some important problems, such as semantic graph analysis, require large-scale irregular applications composed of many coordinating tasks that operate on a shared data set so big it…
Breaking Band: A Breakdown of High-performance Communication
Rohit Zambre, Megan Grodowitz, Aparna Chandramowlishwaran +1
The critical path of internode communication on large-scale systems is composed of multiple components. When a supercomputing application initiates the transfer of a message using…