Large-Small Model Collaboration for Enhancing Edge-Deployed Small Models

Peigen Liu, Yijiang Fan, Zixuan Xu +3

Edge devices host domain-specific small language models (SLMs) with limited resources, while private clouds offer larger LLMs. We propose G-Boost, an adaptive edge-cloud framework…