Data Driven Optimization of GPU efficiency for Distributed LLM-Adapter Serving

Ferran Agullo, Joan Oliveras, Chen Wang +5

Large Language Model (LLM) adapters enable low-cost model specialization, but introduce complex caching and scheduling challenges in distributed serving systems where hundreds of a…