57 citations · 222 across the 15 of their papers we have counts for
15 papers
FastMTP: Accelerating LLM Inference with Enhanced Multi-Token Prediction
Yuxuan Cai, Xiaozhuan Liang, Xinghua Wang +7
As large language models (LLMs) become increasingly powerful, the sequential nature of autoregressive generation creates a fundamental throughput bottleneck that limits the practic…
ChineseHarm-Bench: A Chinese Harmful Content Detection Benchmark
Kangwei Liu, Siyuan Cheng, Bozhong Tian +7
Large language models (LLMs) have been increasingly applied to automated harmful content detection tasks, assisting moderators in identifying policy violations and improving the ov…
SFM-Protein: Integrative Co-evolutionary Pre-training for Advanced Protein Sequence Representation
Liang He, Peiran Jin, Yaosen Min +7
Proteins, essential to biological systems, perform functions intricately linked to their three-dimensional structures. Understanding the relationship between protein structures and…
To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models
Bozhong Tian, Xiaozhuan Liang, Siyuan Cheng +6
Large Language Models (LLMs) trained on extensive corpora inevitably retain sensitive data, such as personal privacy information and copyrighted material. Recent advancements in kn…
BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuning
Qizhi Pei, Lijun Wu, Kaiyuan Gao +6
Recent research trends in computational biology have increasingly focused on integrating text and bio-entity modeling, especially in the context of molecules and proteins. However,…
InstructEdit: Instruction-based Knowledge Editing for Large Language Models
Ningyu Zhang, Bozhong Tian, Siyuan Cheng +6
Knowledge editing for large language models can offer an efficient solution to alter a model's behavior without negatively impacting the overall performance. However, the current a…
Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models
Yin Fang, Xiaozhuan Liang, Ningyu Zhang +5
Large Language Models (LLMs), with their remarkable task-handling capabilities and innovative outputs, have catalyzed significant advancements across a spectrum of fields. However,…
Multimodal Analogical Reasoning over Knowledge Graphs
Ningyu Zhang, Lei Li, Xiang Chen +3
Analogical reasoning is fundamental to human cognition and holds an important place in various fields. However, previous studies mainly focus on single-modal analogical reasoning a…
Multi-modal Protein Knowledge Graph Construction and Applications
Siyuan Cheng, Xiaozhuan Liang, Zhen Bi +2
Existing data-centric methods for protein science generally cannot sufficiently capture and leverage biology knowledge, which may be crucial for many protein tasks. To facilitate r…
Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learning
Xiang Chen, Lei Li, Ningyu Zhang +6
Prompt learning approaches have made waves in natural language processing by inducing better few-shot performance while they still follow a parametric-based learning paradigm; the…
Relphormer: Relational Graph Transformer for Knowledge Graph Representations
Zhen Bi, Siyuan Cheng, Jing Chen +3
Transformers have achieved remarkable performance in widespread fields, including natural language processing, computer vision and graph mining. However, vanilla Transformer archit…
Contrastive Demonstration Tuning for Pre-trained Language Models
Xiaozhuan Liang, Ningyu Zhang, Siyuan Cheng +3
Pretrained language models can be effectively stimulated by textual prompts or demonstrations, especially in low-data scenarios. Recent works have focused on automatically searchin…
OntoProtein: Protein Pretraining With Gene Ontology Embedding
Ningyu Zhang, Zhen Bi, Xiaozhuan Liang +6
Self-supervised protein language models have proved their effectiveness in learning the proteins representations. With the increasing computational power, current protein language…
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population
Ningyu Zhang, Xin Xu, Liankuan Tao +19
We present an open-source and extensible knowledge extraction toolkit DeepKE, supporting complicated low-resource, document-level and multimodal scenarios in the knowledge base pop…
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark
Ningyu Zhang, Mosha Chen, Zhen Bi +20
Artificial Intelligence (AI), along with the recent progress in biomedical language understanding, is gradually changing medical practice. With the development of biomedical langua…