4 papers
Nemotron-Labs-TwoTower: Diffusion Language Modeling with Pretrained Autoregressive Context
Fitsum Reda, John Kamalu, Roger Waleffe +3
Diffusion language models offer a promising alternative to autoregressive models due to their potential for parallel and iterative generation. However, existing approaches use a si…
InfoTok: Adaptive Discrete Video Tokenizer via Information-Theoretic Compression
Haotian Ye, Qiyuan He, Jiaqi Han +12
Accurate and efficient discrete video tokenization is essential for long video sequences processing. Yet, the inherent complexity and variable information density of videos present…
World Simulation with Video Foundation Models for Physical AI
NVIDIA, :, Arslan Ali +87
We introduce [Cosmos-Predict2.5], the latest generation of the Cosmos World Foundation Models for Physical AI. Built on a flow-based architecture, [Cosmos-Predict2.5] unifies Text2…
MambaVideo for Discrete Video Tokenization with Channel-Split Quantization
Dawit Mureja Argaw, Xian Liu, Joon Son Chung +2
Discrete video tokenization is essential for efficient autoregressive generative modeling due to the high dimensionality of video data. This work introduces a state-of-the-art disc…