2 papers
cs.CL2026
Mechanistic Circuit-Based Knowledge Editing in Large Language Models
Tianyi Zhao, Yinhan He, Wendy Zheng +1
Deploying Large Language Models (LLMs) in real-world dynamic environments raises the challenge of updating their pre-trained knowledge. While existing knowledge editing methods can…
cs.LG2025
ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models
Chenyang Song, Xu Han, Zhengyan Zhang +8
Activation sparsity refers to the existence of considerable weakly-contributed elements among activation outputs. As a prevalent property of the models using the ReLU activation fu…