18 citations · 30 across the 17 of their papers we have counts for
4 papers · 1 filter
SWRouter: Similarity-Contractive Window Routing for Multi-Turn Large Language Model Conversations
Yu Wang, Yuchen Li, Rui Kong +11
Large language models exhibit complementary strengths, motivating routing methods that dispatch each query to the most suitable model. Although existing routers are effective in si…
Pruning-Aware Multi-Cluster Co-Inference for Large AI Models in AI-RANs
Xiaowen Cao, Zhonghao Lyu, Shicheng Chu +6
The increasing scale and computational demands of large artificial intelligence models (LAIMs) present significant challenges for efficient inference in resource-constrained distri…
Sense Smarter, Think Better: A Survey on Edge Perception for Next-Generation Networks
Zhonghao Lyu, Xiaowen Cao, Xianxin Song +11
Edge perception has emerged as a foundational capability for future wireless networks, enabling the network edge to proactively sense, interpret, and interact with the physical env…
FlexSpec: Frozen Drafts Meet Evolving Targets in Edge-Cloud Collaborative LLM Speculative Decoding
Yuchen Li, Rui Kong, Zhonghao Lyu +11
Deploying large language models (LLMs) in mobile and edge computing environments is constrained by limited on-device resources, scarce wireless bandwidth, and frequent model evolut…