Automated Heterogeneous Low-Bit Quantization of Multi-Model Deep Learning Inference Pipeline

Jayeeta Mondal, Swarnava Dey, Arijit Mukherjee

Multiple Deep Neural Networks (DNNs) integrated into single Deep Learning (DL) inference pipelines e.g. Multi-Task Learning (MTL) or Ensemble Learning (EL), etc., albeit very accur…