272 citations · 924 across the 63 of their papers we have counts for
8 papers · 1 filter
Large Scale Parallelization Using File-Based Communications
Chansup Byun, Jeremy Kepner, William Arcand +14
In this paper, we present a novel and new file-based communication architecture using the local filesystem for large scale parallelization. This new approach eliminates the issues…
TapirXLA: Embedding Fork-Join Parallelism into the XLA Compiler in TensorFlow Using Tapir
Tao B. Schardl, Siddharth Samsi
This work introduces TapirXLA, a replacement for TensorFlow's XLA compiler that embeds recursive fork-join parallelism into XLA's low-level representation of code. Machine-learning…
Securing HPC using Federated Authentication
Andrew Prout, William Arcand, David Bestor +15
Federated authentication can drastically reduce the overhead of basic account maintenance while simultaneously improving overall system security. Integrating with the user's more f…
Streaming 1.9 Billion Hypersparse Network Updates per Second with D4M
Jeremy Kepner, Vijay Gadepally, Lauren Milechin +15
The Dynamic Distributed Dimensional Data Model (D4M) library implements associative arrays in a variety of languages (Python, Julia, and Matlab/Octave) and provides a lightweight i…
Optimizing Xeon Phi for Interactive Data Analysis
Chansup Byun, Jeremy Kepner, William Arcand +15
The Intel Xeon Phi manycore processor is designed to provide high performance matrix computations of the type often performed in data analysis. Common data analysis environments in…
Lessons Learned from a Decade of Providing Interactive, On-Demand High Performance Computing to Scientists and Engineers
Julia Mullen, Albert Reuther, William Arcand +15
For decades, the use of HPC systems was limited to those in the physical sciences who had mastered their domain in conjunction with a deep understanding of HPC architectures and al…
Scaling Big Data Platform for Big Data Pipeline
Rebecca Wild, Matthew Hubbell, Jeremy Kepner
Monitoring and Managing High Performance Computing (HPC) systems and environments generate an ever growing amount of data. Making sense of this data and generating a platform where…
A Billion Updates per Second Using 30,000 Hierarchical In-Memory D4M Databases
Jeremy Kepner, Vijay Gadepally, Lauren Milechin +15
Analyzing large scale networks requires high performance streaming updates of graph representations of these data. Associative arrays are mathematical objects combining properties…