FanStore: Enabling Efficient and Scalable I/O for Distributed Deep Learning

Zhao Zhang, Lei Huang, Uri Manor +5

Emerging Deep Learning (DL) applications introduce heavy I/O workloads on computer clusters. The inherent long lasting, repeated, and random file access pattern can easily saturate…