1 citations · 1 across the 5 of their papers we have counts for
4 papers · 1 filter
ResidualKV: Residual-Based KV Cache Compression for Efficient Long-Context Inference
Jitai Hao, Qiang Huang, Yaowei Wang +2
Efficient long-context inference faces two coupled bottlenecks: KV-cache memory grows linearly with context length, while attention computation grows quadratically. Existing approa…
A Token is Worth over 1,000 Tokens: Efficient Knowledge Distillation through Low-Rank Clone
Jitai Hao, Qiang Huang, Hao Liu +3
Training high-performing Small Language Models (SLMs) remains costly, even with knowledge distillation and pruning from larger teacher models. Existing work often faces three key c…
MEFT: Memory-Efficient Fine-Tuning through Sparse Adapter
Jitai Hao, WeiWei Sun, Xin Xin +4
Parameter-Efficient Fine-tuning (PEFT) facilitates the fine-tuning of Large Language Models (LLMs) under limited resources. However, the fine-tuning performance with PEFT on comple…
Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoning
Yougang Lyu, Jitai Hao, Zihan Wang +6
Multiple defendants in a criminal fact description generally exhibit complex interactions, and cannot be well handled by existing Legal Judgment Prediction (LJP) methods which focu…