Large-Small Model Collaboration for Enhancing Edge-Deployed Small Models

Yijiang Fan, Peigen Liu, Yuren Mao +5

Edge devices host domain-specific small language models (SLMs) with limited resources, while private clouds offer larger LLMs. We propose G-Boost, an adaptive edge-cloud framework…