SLICE: SLO-Driven Scheduling for LLM Inference on Edge Computing Devices

Will Chow

Large Language Models (LLMs), as the foundational architecture for next-generation interactive AI applications, not only power intelligent dialogue systems but also drive the evolu…