A Framework for Cost-Effective and Self-Adaptive LLM Shaking and Recovery Mechanism

Zhiyu Chen, Yu Li, Suochao Zhang +4

As Large Language Models (LLMs) gain great success in real-world applications, an increasing number of users are seeking to develop and deploy their customized LLMs through cloud s…