1 citations · 1 across the 5 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.CL2024
More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression
Jiebin Zhang, Dawei Zhu, Yifan Song +6
As large language models (LLMs) process increasing context windows, the memory usage of KV cache has become a critical bottleneck during inference. The mainstream KV compression me…
cs.CL2024
Evaluating Robustness of Generative Search Engine on Adversarial Factual Questions
Xuming Hu, Xiaochuan Li, Junzhe Chen +8
Generative search engines have the potential to transform how people seek information online, but generated responses from existing large language models (LLMs)-backed generative s…
cs.CL2024
WIKIGENBENCH: Exploring Full-length Wikipedia Generation under Real-World Scenario
Jiebin Zhang, Eugene J. Yu, Qinyu Chen +8
It presents significant challenges to generate comprehensive and accurate Wikipedia articles for newly emerging events under a real-world scenario. Existing attempts fall short eit…