4 papers · 1 filter
Behind Video Generation: Observations and Insights on Multimodal Understanding from Kling
Kling Team, Dong Chen, Jialu Chen +50
Video generation has progressed from isolated clips to coherent short-form audiovisual sequences, and the bottleneck is shifting from rendering to semantic control. This report sum…
Reviso: Not All Visual Evidence Deserves Equal Attention in Video Captioning
Tengfei Liu, Yang Shi, Yuran Wang +12
Multimodal large language models (MLLMs) can generate detailed video captions, yet they may overemphasize minor details while overlooking essential context and key events. We argue…
V-RAE: Rethinking Video Latent Spaces for Generation
Minghui Guo, Shengqiong Wu, Hao Fei
Latent video generation relies on autoencoders to define a compact space in which generative models operate. Although video autoencoder architectures have evolved substantially, th…
UniM: A Unified Any-to-Any Interleaved Multimodal Benchmark
Yanlin Li, Minghui Guo, Kaiwen Zhang +13
In real-world multimodal applications, systems usually need to comprehend arbitrarily combined and interleaved multimodal inputs from users, while also generating outputs in any in…