most citedA Survey on Efficient Inference for Large Language Models

23 citations · 32 across the 5 of their papers we have counts for

collaborators

5 papers

cs.AI2026

EAPO: Entropy-Driven Adaptive Positive-Negative Sample Weighting for Policy Optimization in Open-Ended QA

Yunsheng Zeng, Gen Li, Yuwei Miao +8

Large Reasoning Models are typically trained via reinforcement learning from verifiable rewards (RLVR). However, existing approaches adopt fixed weights for positive and negative s…

cs.AI2026

C-MIG: Multi-view Information Gain-based Retrieval-Augmented Generation for Clinical Diagnosis Reasoning

Yuwei Miao, Gen Li, Yunsheng Zeng +8

Retrieval-augmented generation (RAG) trained with reinforcement learning (RL) is a promising way to ground large language models in medical evidence for clinical diagnosis. However…

cs.LG2024

CSKV: Training-Efficient Channel Shrinking for KV Cache in Long-Context Scenarios

Luning Wang, Shiyao Li, Xuefei Ning +4

Large Language Models (LLMs) have been widely adopted to process long-context tasks. However, the large memory overhead of the key-value (KV) cache poses significant challenges in…

cs.CL2024★ 23 cited

A Survey on Efficient Inference for Large Language Models

Zixuan Zhou, Xuefei Ning, Ke Hong +12

Large Language Models (LLMs) have attracted extensive attention due to their remarkable performance across various tasks. However, the substantial computational and memory requirem…

cs.CL2024★ 9 cited

Evaluating Quantized Large Language Models

Shiyao Li, Xuefei Ning, Luning Wang +6

Post-training quantization (PTQ) has emerged as a promising technique to reduce the cost of large language models (LLMs). Specifically, PTQ can effectively mitigate memory consumpt…