Efficiency optimization of large-scale language models based on deep learning in natural language processing tasks

Taiyuan Mei, Yun Zi, Xiaohan Cheng +3

The internal structure and operation mechanism of large-scale language models are analyzed theoretically, especially how Transformer and its derivative architectures can restrict c…