A Computational-Graph Partitioning Method for Training Memory-Constrained DNNs

Fareed Qararyah, Mohamed Wahib, Doğa Dikbayır +2

Many state-of-the-art Deep Neural Networks (DNNs) have substantial memory requirements. Limited device memory becomes a bottleneck when training those models. We propose ParDNN, an…