When Compliance Data Masquerades as Evaluation: Measurement Validity for Deployed AI Systems

Hung-Yu Lin, Xingran Huang, Qiming Guo +1

We argue that a recurring failure in the evaluation of deployed AI systems occurs when data collected for operational monitoring or regulatory compliance are interpreted as if they…