Roles of Scaling and Instruction Tuning in Language Perception: Model vs. Human Attention

Changjiang Gao, Shujian Huang, Jixing Li +1

Recent large language models (LLMs) have revealed strong abilities to understand natural language. Since most of them share the same basic structure, i.e. the transformer block, po…