Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
SAMoRA: Semantic-Aware Mixture of LoRA Experts for Task-Adaptive Learning
Boyan Shi, Wei Chen, Shuyuan Zhao +4
The combination of Mixture-of-Experts (MoE) and Low-Rank Adaptation (LoRA) has shown significant potential for enhancing the multi-task learning capabilities of Large Language Mode…
cs.CL2025
G-KV: Decoding-Time KV Cache Eviction with Global Attention
Mengqi Liao, Lu Wang, Chaoyun Zhang +7
Recent reasoning large language models (LLMs) excel in complex tasks but encounter significant computational and memory challenges due to long sequence lengths. KV cache compressio…