Empirical Guidelines for Deploying LLMs onto Resource-constrained Edge Devices

Ruiyang Qin, Dancheng Liu, Chenhui Xu +9

The scaling laws have become the de facto guidelines for designing large language models (LLMs), but they were studied under the assumption of unlimited computing resources for bot…