4 citations · 12 across the 17 of their papers we have counts for
17 papers
Thallus: An RDMA-based Columnar Data Transport Protocol
Jayjeet Chakraborty, Matthieu Dorier, Philip Carns +3
The volume of data generated and stored in contemporary global data centers is experiencing exponential growth. This rapid data growth necessitates efficient processing and analysi…
A Moveable Beast: Partitioning Data and Compute for Computational Storage
Aldrin Montana, Yuanqing Xue, Jeff LeFevre +4
Over the years, hardware trends have introduced various heterogeneous compute units while also bringing network and storage bandwidths within an order of magnitude of memory subsys…
Mapping Out the HPC Dependency Chaos
Farid Zakaria, Thomas R. W. Scogland, Todd Gamblin +1
High Performance Computing~(HPC) software stacks have become complex, with the dependencies of some applications numbering in the hundreds. Packaging, distributing, and administeri…
Processing Particle Data Flows with SmartNICs
Jianshen Liu, Carlos Maltzahn, Matthew L. Curry +1
Many distributed applications implement complex data flows and need a flexible mechanism for routing data between producers and consumers. Recent advances in programmable network i…
Snowmass 2021 Computational Frontier CompF4 Topical Group Report: Storage and Processing Resource Access
W. Bhimji, D. Carder, E. Dart +17
Computing plays a significant role in all areas of high energy physics. The Snowmass 2021 CompF4 topical group's scope is facilities R&D, where we consider "facilities" as the comp…
Managing Bufferbloat in Cloud Storage Systems
Seyed Esmaeil Mirvakili, Samuel Just, Carlos Maltzahn
Today, companies and data centers are moving towards cloud and serverless storage systems instead of traditional file systems. As a result of such a transition, allocating sufficie…
Skyhook: Towards an Arrow-Native Storage System
Jayjeet Chakraborty, Ivo Jimenez, Sebastiaan Alvarez Rodriguez +3
With the ever-increasing dataset sizes, several file formats such as Parquet, ORC, and Avro have been developed to store data efficiently, save the network, and interconnect bandwi…
Zero-Cost, Arrow-Enabled Data Interface for Apache Spark
Sebastiaan Alvarez Rodriguez, Jayjeet Chakraborty, Aaron Chu +4
Distributed data processing ecosystems are widespread and their components are highly specialized, such that efficient interoperability is urgent. Recently, Apache Arrow was chosen…
Towards an Arrow-native Storage System
Jayjeet Chakraborty, Ivo Jimenez, Sebastiaan Alvarez Rodriguez +3
With the ever-increasing dataset sizes, several file formats like Parquet, ORC, and Avro have been developed to store data efficiently and to save network and interconnect bandwidt…
Performance Characteristics of the BlueField-2 SmartNIC
Jianshen Liu, Carlos Maltzahn, Craig Ulmer +1
High-performance computing (HPC) researchers have long envisioned scenarios where application workflows could be improved through the use of programmable processing elements embedd…
The CROSS Incubator: A Case Study for funding and training RSEs
Stephanie Lieggi, Ivo Jimenez, Jeff LeFevre +1
The incubator and research projects sponsored by the Center for Research in Open Source Software (CROSS, cross.ucsc.edu) at UC Santa Cruz have been very effective at promoting the…
Mapping Datasets to Object Storage System
Xiaowei, Chu, Jeff LeFevre +5
Access libraries such as ROOT and HDF5 allow users to interact with datasets using high level abstractions, like coordinate systems and associated slicing operations. Unfortunately…
Is Big Data Performance Reproducible in Modern Cloud Networks?
Alexandru Uta, Alexandru Custura, Dmitry Duplyakin +5
Performance variability has been acknowledged as a problem for over a decade by cloud practitioners and performance engineers. Yet, our survey of top systems conferences reveals th…
MBWU: Benefit Quantification for Data Access Function Offloading
Jianshen Liu, Philip Kufeldt, Carlos Maltzahn
The storage industry is considering new kinds of storage devices that support data access function offloading, i.e. the ability to perform data access functions on the storage devi…
HEP Software Foundation Community White Paper Working Group -- Data Organization, Management and Access (DOMA)
Dario Berzano, Riccardo Maria Bianchi, Ian Bird +35
Without significant changes to data organization, management, and access (DOMA), HEP experiments will find scientific output limited by how fast data can be accessed and digested b…
HEP Software Foundation Community White Paper Working Group - Data and Software Preservation to Enable Reuse
M. D. Hildreth, A. Boehnlein, K. Cranmer +20
In this chapter of the High Energy Physics Software Foundation Community Whitepaper, we discuss the current state of infrastructure, best practices, and ongoing developments in the…
Distributed Versioned Object Storage -- Alternatives at the OSD layer (Poster Extended Abstract)
Ivo Jimenez, Carlos Maltzahn, Jay Lofstead
The ability to store multiple versions of a data item is a powerful primitive that has had a wide variety of uses: relational databases, transactional memory, version control syste…