Chain-of-Model Learning for Language Model

Kaitao Song, Xiaohua Wang, Xu Tan +14

In this paper, we propose a novel learning paradigm, termed Chain-of-Model (CoM), which incorporates the causal relationship into the hidden states of each layer as a chain style,…