1 paper · 1 filter
Hai Lin, Hoilam Pao, Shaoxiong Zhan +1
Large language models are undergoing a transition from model technology to system technology. Engineering challenges like cache reuse, context capacity, agent scheduling, and permi…