Showing cs.DCShow all
3 papers · 1 filter
cs.DC2022
Skyhook: Towards an Arrow-Native Storage System
Jayjeet Chakraborty, Ivo Jimenez, Sebastiaan Alvarez Rodriguez +3
With the ever-increasing dataset sizes, several file formats such as Parquet, ORC, and Avro have been developed to store data efficiently, save the network, and interconnect bandwi…
cs.DC2021
Towards an Arrow-native Storage System
Jayjeet Chakraborty, Ivo Jimenez, Sebastiaan Alvarez Rodriguez +3
With the ever-increasing dataset sizes, several file formats like Parquet, ORC, and Avro have been developed to store data efficiently and to save network and interconnect bandwidt…
cs.DC2020
Mapping Datasets to Object Storage System
Xiaowei, Chu, Jeff LeFevre +5
Access libraries such as ROOT and HDF5 allow users to interact with datasets using high level abstractions, like coordinate systems and associated slicing operations. Unfortunately…