37 citations · 37 across the 15 of their papers we have counts for
Showing 2024 · cs.CLShow all
3 papers · 2 filters
cs.CL2024
Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning
Yu Fu, Zefan Cai, Abedelkadir Asi +3
Key-Value (KV) caching is a common technique to enhance the computational efficiency of Large Language Models (LLMs), but its memory overhead grows rapidly with input length. Prior…
cs.CL2024
TRAWL: Tensor Reduced and Approximated Weights for Large Language Models
Yiran Luo, Het Patel, Yu Fu +4
Recent research has shown that pruning large-scale language models for inference is an effective approach to improving model efficiency, significantly reducing model weights with m…
cs.CL2024
Cross-Task Defense: Instruction-Tuning LLMs for Content Safety
Yu Fu, Wen Xiao, Jia Chen +4
Recent studies reveal that Large Language Models (LLMs) face challenges in balancing safety with utility, particularly when processing long texts for NLP tasks like summarization a…