5 papers
AnyAct: Towards Human Reenactment of Character Motion From Video
Liuhan Chen, Lei Zhong, Jiawei Wang +6
We study the problem of directly deriving an initial human reenactment from a monocular video of a non-human character. Our goal is not to reconstruct the source character itself b…
360° Image Perception with MLLMs: A Comprehensive Benchmark and a Training-Free Method
Huyen T. T. Tran, Van-Quang Nguyen, Farros Alferro +2
Multimodal Large Language Models (MLLMs) have shown impressive abilities in understanding and reasoning over conventional images. However, their perception of 360° images remains l…
CLIP-GS: CLIP-Informed Gaussian Splatting for View-Consistent 3D Indoor Semantic Understanding
Guibiao Liao, Jiankun Li, Zhenyu Bao +3
Exploiting 3D Gaussian Splatting (3DGS) with Contrastive Language-Image Pre-Training (CLIP) models for open-vocabulary 3D semantic understanding of indoor scenes has emerged as an…
MGStream: Motion-aware 3D Gaussian for Streamable Dynamic Scene Reconstruction
Zhenyu Bao, Qing Li, Guibiao Liao +2
3D Gaussian Splatting (3DGS) has gained significant attention in streamable dynamic novel view synthesis (DNVS) for its photorealistic rendering capability and computational effici…
SPC-GS: Gaussian Splatting with Semantic-Prompt Consistency for Indoor Open-World Free-view Synthesis from Sparse Inputs
Guibiao Liao, Qing Li, Zhenyu Bao +2
3D Gaussian Splatting-based indoor open-world free-view synthesis approaches have shown significant performance with dense input images. However, they exhibit poor performance when…