Efficient Memory Management for Deep Neural Net Inference

Yury Pisarchyk, Juhyun Lee

While deep neural net inference was considered a task for servers only, latest advances in technology allow the task of inference to be moved to mobile and embedded devices, desire…