SUNTA: Hierarchical Video Prediction with Surprise-based Chunking

Tomoshi Iiyama, Masahiro Suzuki, Yutaka Matsuo

Hierarchical state-space models (HSSMs) offer a promising approach to long-horizon prediction by segmenting sequences into temporal chunks. However, their performance hinges on how…