When Better Policies Leave Harder Failures: Coverage Shift in VLM Success Monitoring

Isabel Guan, Dingyuan Zhang, Shipeng Lyu +1

Can a better robot policy become harder to monitor? We study a fixed vision-language model (VLM) that judges success while a policy improves. In a controlled 20-seed tray-placement…