Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
GetBatch: Distributed Multi-Object Retrieval for ML Data Loading
Alex Aizman, Abhishek Gaikwad, Piotr Żelasko
Machine learning training pipelines consume data in batches. A single training step may require thousands of samples drawn from shards distributed across a storage cluster. Issuing…
cs.DC2020
High Performance I/O For Large Scale Deep Learning
Alex Aizman, Gavin Maltby, Thomas Breuel
Training deep learning (DL) models on petascale datasets is essential for achieving competitive and state-of-the-art performance in applications such as speech, video analytics, an…