Algebraic Consistency Alone Does Not Certify Temporal Structure in Latent Action Models

Di Wen, Ruodi Zhang, Kailun Yang +1

Latent action models infer a code for the transition between two frames of action-free video. Recent methods regularise this code to compose additively and reverse antisymmetricall…