32 citations · 52 across the 7 of their papers we have counts for
7 papers
Beyond Token Eviction: Mixed-Dimension Budget Allocation for Efficient KV Cache Compression
Ruijie Miao, Zhiming Wang, Wang Li +4
Key-value (KV) caching is widely used to accelerate transformer inference, but its memory cost grows linearly with input length, limiting long-context deployment. Existing token ev…
KVReviver: Reversible KV Cache Compression with Sketch-Based Token Reconstruction
Aomufei Yuan, Zhiming Wang, Ruijie Miao +8
As the context length of current large language models (LLMs) rapidly increases, the memory demand for the Key-Value (KV) cache is becoming a bottleneck for LLM deployment and batc…
MergeMoE: Efficient Compression of MoE Models via Expert Output Merging
Ruijie Miao, Yilun Yao, Zihan Wang +5
The Mixture-of-Experts (MoE) technique has proven to be a promising solution to efficiently scale the model size, which has been widely applied in recent LLM advancements. However,…
Inverse IFEval: Can LLMs Unlearn Stubborn Training Conventions to Follow Real Instructions?
Qinyan Zhang, Xinping Lei, Ruijie Miao +18
Large Language Models (LLMs) achieve strong performance on diverse tasks but often exhibit cognitive inertia, struggling to follow instructions that conflict with the standardized…
An Efficient Inference Framework for Early-exit Large Language Models
Ruijie Miao, Yihan Yan, Xinshuo Yao +1
Building efficient inference framework has gained increasing interests for research community. Early-exit models, a variant of LLMs, improves the inference efficiency of LLMs by sk…
ChameleMon: Shifting Measurement Attention as Network State Changes
Kaicheng Yang, Yuhan Wu, Ruijie Miao +8
Flow-level network measurement is critical to many network applications. Among various measurement tasks, packet loss detection and heavy-hitter detection are two most important me…
Overcoming noise in quantum teleportation with multipartite hybrid entanglement
Zhao-Di Liu, Olli Siltanen, Tom Kuusela +5
Quantum entanglement and decoherence are the two counterforces of many quantum technologies and protocols. For example, while quantum teleportation is fueled by a pair of maximally…