CALIPER: Clean Scenes Cannot Rank Physical Inference in Pretrained Visual Representations

Aman Mehta, Riya Baviskar

How far a pushed object slides depends on its mass and friction, which no single image reveals. Pretrained visual encoders are increasingly used as the perception front end of worl…