tf.data service: A Case for Disaggregating ML Input Data Processing

Andrew Audibert, Yang Chen, Dan Graur +3

Machine learning (ML) computations commonly execute on expensive specialized hardware, such as GPUs and TPUs, which provide high FLOPs and performance-per-watt. For cost efficiency…