6 papers
FastMTP: Accelerating LLM Inference with Enhanced Multi-Token Prediction
Yuxuan Cai, Xiaozhuan Liang, Xinghua Wang +7
As large language models (LLMs) become increasingly powerful, the sequential nature of autoregressive generation creates a fundamental throughput bottleneck that limits the practic…
ChineseHarm-Bench: A Chinese Harmful Content Detection Benchmark
Kangwei Liu, Siyuan Cheng, Bozhong Tian +7
Large language models (LLMs) have been increasingly applied to automated harmful content detection tasks, assisting moderators in identifying policy violations and improving the ov…
SFM-Protein: Integrative Co-evolutionary Pre-training for Advanced Protein Sequence Representation
Liang He, Peiran Jin, Yaosen Min +7
Proteins, essential to biological systems, perform functions intricately linked to their three-dimensional structures. Understanding the relationship between protein structures and…
To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models
Bozhong Tian, Xiaozhuan Liang, Siyuan Cheng +6
Large Language Models (LLMs) trained on extensive corpora inevitably retain sensitive data, such as personal privacy information and copyrighted material. Recent advancements in kn…
BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuning
Qizhi Pei, Lijun Wu, Kaiyuan Gao +6
Recent research trends in computational biology have increasingly focused on integrating text and bio-entity modeling, especially in the context of molecules and proteins. However,…
InstructEdit: Instruction-based Knowledge Editing for Large Language Models
Ningyu Zhang, Bozhong Tian, Siyuan Cheng +6
Knowledge editing for large language models can offer an efficient solution to alter a model's behavior without negatively impacting the overall performance. However, the current a…