Enabling On-Device Medical AI Assistants via Input-Driven Saliency Adaptation

Uttej Kallakurik, Edward Humes, Rithvik Jonna +2

Large Language Models (LLMs) have significant impact on the healthcare scenarios but remain prohibitively large for deployment in real-time, resource-constrained environments such…