6 papers
Flex4DHuman: Flexible Multi-view Video Diffusion for 4D Human Reconstruction
Jen-Hao Cheng, Yipeng Wang, Hao Zhang +2
We present Flex4DHuman, a multi-view video diffusion model that transforms a monocular or sparse multi-view video of a dynamic subject into synchronized dense multi-view videos usi…
World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible
Hao Zhang, Mohamed El Banani, Jen-Hao Cheng +6
Image-to-3D methods often trade off faithfulness and completeness: depth estimators are anchored to input pixels but stop at the visible surface, while image-to-3D models generate…
Reasoning Matters for 3D Visual Grounding
Hsiang-Wei Huang, Kuang-Ming Chen, Wenhao Chai +3
The recent development of Large Language Models (LLMs) with strong reasoning ability has driven research in various domains such as mathematics, coding, and scientific discovery. M…
Warehouse Spatial Question Answering with LLM Agent
Hsiang-Wei Huang, Jen-Hao Cheng, Kuang-Ming Chen +8
Spatial understanding has been a challenging task for existing Multi-modal Large Language Models~(MLLMs). Previous methods leverage large-scale MLLM finetuning to enhance MLLM's sp…
TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action
Jen-Hao Cheng, Vivian Wang, Huayu Wang +11
Understanding causal event relationships and achieving fine-grained temporal grounding in videos remain challenging for vision-language models. Existing methods either compress vid…
MonoTAKD: Teaching Assistant Knowledge Distillation for Monocular 3D Object Detection
Hou-I Liu, Christine Wu, Jen-Hao Cheng +8
Monocular 3D object detection (Mono3D) holds noteworthy promise for autonomous driving applications owing to the cost-effectiveness and rich visual context of monocular camera sens…