1 citations · 3 across the 22 of their papers we have counts for
4 papers · 1 filter
RippleKV: Cross-Layer KV Cache Allocation via Perturbation Propagation
Dongjie Xu, Kai Qian, Julius +6
Long-context LLM inference is bottlenecked by KV cache memory, yet distributing a limited cache budget across layers remains challenging. Existing methods rely on proxies such as l…
Cognitive-Uncertainty Guided Knowledge Distillation for Accurate Classification of Student Misconceptions
Qirui Liu, Hao Chen, Weijie Shi +2
Accurately identifying student misconceptions is crucial for personalized education but faces three challenges: (1) data scarcity with long-tail distribution, where authentic stude…
RL: Reflect-then-Retry Reinforcement Learning with Language-Guided Exploration, Pivotal Credit, and Positive Amplification
Weijie Shi, Yanxi Chen, Zexi Li +5
Reinforcement learning drives recent advances in LLM reasoning and agentic capabilities, yet current approaches struggle with both exploration and exploitation. Exploration suffers…
PIP: Perturbation-based Iterative Pruning for Large Language Models
Yi Cao, Wei-Jie Xu, Yucheng Shen +4
The rapid increase in the parameter counts of Large Language Models (LLMs), which often reach into the billions or even trillions, presents significant challenges for their practic…