5 citations · 10 across the 11 of their papers we have counts for
Showing 2025Show all
3 papers · 1 filter
cs.CL2025
CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference
Dong Liu, Shu Wang, Yanxuan Yu +2
Large language models face significant computational bottlenecks during inference due to the expensive output layer computation over large vocabularies. We present CSV-Decode, a no…
cs.DC2025
PiKV: KV Cache Management System for Mixture of Experts
Dong Liu, Yanxuan Yu, Ben Lengerich +1
As large-scale language models continue to scale up in both size and context length, the memory and communication cost of key-value (KV) cache storage has become a major bottleneck…
cs.LG2025
FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation
Dong Liu, Yanxuan Yu, Jiayi Zhang +3
Diffusion Transformers (DiT) are powerful generative models but remain computationally intensive due to their iterative structure and deep transformer stacks. To alleviate this ine…