Human versus Computer Vision

Abstract

Computer vision saliency models predict where people will look, one map per image, and a predicted-attention industry sells those maps in place of measuring real viewers. I evaluate the leading models against every publicly available eye-tracking corpus that records viewer demographics, comprising 27,384 participants across eight datasets, including 11.4 million webcam gaze points from 2,993 US adults recruited to national quotas while viewing circulating news images. I show that a single map predicts where every group looks about equally well, but systematically ignores how long each place holds a group's attention. That time follows a clear sociodemographic and political fingerprint, so the map carries a systematic bias against the youngest and oldest viewers and against Black, lower-income, and Republican-leaning ones. I use each group's own gaze to test whether it carries a learnable pattern, across every demographic axis the sample supports. Showing which audiences these systems can learn and what determines this sets the standard for judging claims that computer vision captures diverse human vision.