Evaluating Multi-Instance DNN Inferencing on Multiple Accelerators of an Edge Device

Mumuksh Tayal, Yogesh Simmhan

Edge devices like Nvidia Jetson platforms now offer several on-board accelerators -- including GPU CUDA cores, Tensor Cores, and Deep Learning Accelerators (DLA) -- which can be co…