4 papers
FNF: Functional Network Fingerprint for Large Language Models
Yiheng Liu, Junhao Ning, Sichen Xia +8
The development of large language models (LLMs) is costly and has significant commercial value. Consequently, preventing unauthorized appropriation of open-source LLMs and protecti…
Jacobian-Based Interpretation of Nonlinear Neural Encoding Model
Xiaohui Gao, Haoran Yang, Yue Cheng +4
In recent years, the alignment between artificial neural network (ANN) embeddings and blood oxygenation level dependent (BOLD) responses in functional magnetic resonance imaging (f…
Pruning Large Language Models by Identifying and Preserving Functional Networks
Yiheng Liu, Junhao Ning, Sichen Xia +5
Structured pruning is one of the representative techniques for compressing large language models (LLMs) to reduce GPU memory consumption and accelerate inference speed. It offers s…
Brain-Inspired Exploration of Functional Networks and Key Neurons in Large Language Models
Yiheng Liu, Zhengliang Liu, Zihao Wu +10
In recent years, the rapid advancement of large language models (LLMs) in natural language processing has sparked significant interest among researchers to understand their mechani…