2 citations · 4 across the 9 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024
More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression
Jiebin Zhang, Dawei Zhu, Yifan Song +6
As large language models (LLMs) process increasing context windows, the memory usage of KV cache has become a critical bottleneck during inference. The mainstream KV compression me…
cs.CL2024
WIKIGENBENCH: Exploring Full-length Wikipedia Generation under Real-World Scenario
Jiebin Zhang, Eugene J. Yu, Qinyu Chen +8
It presents significant challenges to generate comprehensive and accurate Wikipedia articles for newly emerging events under a real-world scenario. Existing attempts fall short eit…