5 citations · 9 across the 3 of their papers we have counts for
3 papers
cs.DC2025
PiKV: KV Cache Management System for Mixture of Experts
Dong Liu, Yanxuan Yu, Ben Lengerich +1
As large-scale language models continue to scale up in both size and context length, the memory and communication cost of key-value (KV) cache storage has become a major bottleneck…
cs.CV2025★ 4 cited
Visual Large Language Models for Generalized and Specialized Applications
Yifan Li, Zhixin Lai, Wentao Bao +7
Visual-language models (VLM) have emerged as a powerful tool for learning a unified embedding space for vision and language. Inspired by large language models, which have demonstra…
cs.DC2024★ 5 cited
Designing Large Foundation Models for Efficient Training and Inference: A Survey
Dong Liu, Yanxuan Yu, Yite Wang +5
This paper focuses on modern efficient training and inference technologies on foundation models and illustrates them from two perspectives: model and system design. Model and Syste…