2 citations · 2 across the 3 of their papers we have counts for
1 paper · 1 filter
Yijun Sun, Xudong Liao, Songrun Xie +5
Meeting stringent Time-To-First-Token (TTFT) requirements is crucial for LLM applications. To improve efficiency, modern LLM serving systems adopt disaggregated architectures with…