Improving the Performance of DNN-based Software Services using Automated Layer Caching

Mohammadamin Abedi, Yanni Iouannou, Pooyan Jamshidi +1

Deep Neural Networks (DNNs) have become an essential component in many application domains including web-based services. A variety of these services require high throughput and (cl…