4 citations · 8 across the 6 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.CL2024
Lossless KV Cache Compression to 2%
Zhen Yang, J. N. Han, Kan Wu +4
Large language models have revolutionized data processing in numerous domains, with their ability to handle extended context reasoning receiving notable recognition. To speed up in…
cs.CL2024★ 2 cited
HMoE: Heterogeneous Mixture of Experts for Language Modeling
An Wang, Xingwu Sun, Ruobing Xie +9
Mixture of Experts (MoE) offers remarkable performance and computational efficiency by selectively activating subsets of model parameters. Traditionally, MoE models use homogeneous…
cs.CL2024
Building a Japanese Document-Level Relation Extraction Dataset Assisted by Cross-Lingual Transfer
Youmi Ma, An Wang, Naoaki Okazaki
Document-level Relation Extraction (DocRE) is the task of extracting all semantic relationships from a document. While studies have been conducted on English DocRE, limited attenti…