2 papers
cs.CL2026
HyLRA: Hybrid Layer Reuse Attention for Efficient Long-Context Inference
Xuan Ai, Qingqing Yang, Peng Wang +4
Long-context inference in Large Language Models (LLMs) is bottlenecked by the quadratic computation complexity of attention and the substantial memory footprint of Key-Value (KV) c…
cs.NI2023
dMAPAR-HMM: Reforming Traffic Model for Improving Performance Bound with Stochastic Network Calculus
Qingqing Yang, Xi Peng, Huiwen Yang +2
A popular branch of stochastic network calculus (SNC) utilizes moment-generating functions (MGFs) to characterize arrivals and services, which enables end-to-end performance analys…