12 papers · 1 filter
ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing
Xinghao Chen, Xiangbo Gao, Jiongze Yu +2
Recent video generation is increasingly realistic and controllable, yet video editing remains less developed, particularly for precise local edits that must preserve the original s…
Weather-Conditioned Depth Anything
Zhaoming Xu, Chan-Wei Hu, Kuan-Ru Huang +4
Monocular depth estimation foundation models, such as the Depth Anything series, have achieved remarkable performance across diverse domains. However, they still suffer from critic…
Visko Orbis 1.0: A Live Model for Real-Time Interactive Long Video Generation
Xiangbo Gao, Siyuan Yang, Ping He +12
We present Visko Orbis 1.0, a Live Model for real-time, interactive long video generation. Users can change the prompt at any moment during generation, and the update becomes visib…
4KLSDB: A Large-Scale Dataset for 4K Image Restoration and Generation
Zihao Zhu, Kuan-Ru Huang, Zhaoming Xu +6
High-resolution datasets are essential for advancing super-resolution (SR) and text-to-image (T2I) diffusion research. However, current publicly available datasets lack both the na…
Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generation
Yuheng Wu, Xiangbo Gao, Tianhao Chen +4
Interactive real-time autoregressive video generation is essential for applications such as content creation and world modeling, where visual content must adapt to dynamically evol…
Physics-Aware Video Instance Removal Benchmark
Zirui Li, Xinghao Chen, Lingyu Jiang +5
Video Instance Removal (VIR) requires removing target objects while maintaining background integrity and physical consistency, such as specular reflections and illumination interac…
The Pulse of Motion: Measuring Physical Frame Rate from Visual Dynamics
Xiangbo Gao, Mingyang Wu, Siyuan Yang +4
While recent generative video models have achieved remarkable visual realism and are being explored as world models, true physical simulation requires mastering both space and time…
PISCO: Precise Video Instance Insertion with Sparse Control
Xiangbo Gao, Renjie Li, Xinghao Chen +4
The landscape of AI video generation is undergoing a pivotal shift: moving beyond general generation - which relies on exhaustive prompt-engineering and "cherry-picking" - towards…
SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagation
Jiongze Yu, Xiangbo Gao, Pooja Verlani +4
Video Super-Resolution (VSR) aims to restore high-quality video frames from low-resolution (LR) estimates, yet most existing VSR approaches behave like black boxes at inference tim…
T2T-VICL: Cross-Task Visual In-Context Learning via Implicit Text-Driven VLMs
Shao-Jun Xia, Huixin Zhang, Zhengzhong Tu
Visual in-context learning (VICL) solves visual tasks by conditioning on a few input-output demonstrations without any model training. Recent advances in large vision-language mode…
HeadsUp! High-Fidelity Portrait Image Super-Resolution
Renjie Li, Zihao Zhu, Xiaoyu Wang +1
Portrait pictures, which typically feature both human subjects and natural backgrounds, are one of the most prevalent forms of photography on social media. Existing image super-res…
MMHU: A Massive-Scale Multimodal Benchmark for Human Behavior Understanding
Renjie Li, Ruijie Ye, Mingyang Wu +4
Humans are integral components of the transportation ecosystem, and understanding their behaviors is crucial to facilitating the development of safe driving systems. Although recen…