10 citations · 27 across the 21 of their papers we have counts for
4 papers · 1 filter
Improving Generalization in LLM Structured Pruning via Function-Aware Neuron Grouping
Tao Yu, Yongqi An, Kuan Zhu +3
Large Language Models (LLMs) demonstrate impressive performance across natural language tasks but incur substantial computational and storage costs due to their scale. Post-trainin…
MME-Industry: A Cross-Industry Multimodal Evaluation Benchmark
Dongyi Yi, Guibo Zhu, Chenglin Ding +3
With the rapid advancement of Multimodal Large Language Models (MLLMs), numerous evaluation benchmarks have emerged. However, comprehensive assessments of their performance across…
Recurrent Context Compression: Efficiently Expanding the Context Window of LLM
Chensen Huang, Guibo Zhu, Xuepeng Wang +5
To extend the context length of Transformer-based large language models (LLMs) and improve comprehension capabilities, we often face limitations due to computational resources and…
ChineseWebText: Large-scale High-quality Chinese Web Text Extracted with Effective Evaluation Model
Jianghao Chen, Pu Jian, Tengxiao Xi +7
During the development of large language models (LLMs), the scale and quality of the pre-training data play a crucial role in shaping LLMs' capabilities. To accelerate the research…