From Cognition to Computation: A Comparative Review of Human Attention and Transformer Architectures

Minglu Zhao, Dehong Xu, Tao Gao

Attention is a cornerstone of human cognition that facilitates the efficient extraction of information in everyday life. Recent developments in artificial intelligence like the Tra…