1 paper · 1 filter
Zijie Su, Muhammed Tawfiqul Islam, Mohammad Goudarzi +1
With the rapid advancement of large language models (LLMs), efficiently serving LLM inference under limited GPU resources has become a critical challenge. Recently, an increasing n…