Attention Function as an Intrinsic Inductive Bias: How Models' Behavior Diverges in Novel Contexts

Dong Gyun Kang, Megha Thukral, Kwangsoo Kim

Developmental psychology holds that certain priors are given to infants prior to experience rather than induced from data, and that the influence of such priors is suppressed under…