6 citations · 11 across the 10 of their papers we have counts for
11 papers
Less Data, Faster Convergence: Goal-Driven Data Optimization for Multimodal Instruction Tuning
Rujie Wu, Haozhe Zhao, Hai Ci +1
Multimodal instruction tuning is often compute-inefficient because training budgets are spread across large mixed image-video pools whose utility is highly uneven. We present Goal-…
LongViTU: Instruction Tuning for Long-Form Video Understanding
Rujie Wu, Xiaojian Ma, Hai Ci +5
This paper introduces LongViTU, a large-scale (~121k QA pairs, ~900h videos), automatically generated dataset for long-form video understanding. We propose a systematic approach th…
UnrealZoo: Enriching Photo-realistic Virtual Worlds for Embodied AI
Fangwei Zhong, Kui Wu, Churan Wang +4
We introduce UnrealZoo, a collection of over 100 photo-realistic 3D virtual worlds built on Unreal Engine, designed to reflect the complexity and variability of open-world environm…
FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modeling
Hang Ye, Xiaoxuan Ma, Hai Ci +2
Achieving realistic animated human avatars requires accurate modeling of pose-dependent clothing deformations. Existing learning-based methods heavily rely on the Linear Blend Skin…
Empowering Embodied Visual Tracking with Visual Foundation Models and Offline RL
Fangwei Zhong, Kui Wu, Hai Ci +2
Embodied visual tracking is to follow a target object in dynamic 3D environments using an agent's egocentric vision. This is a vital and challenging skill for embodied agents. Howe…
Efficient Action Counting with Dynamic Queries
Xiaoxuan Ma, Zishi Li, Qiuyan Shang +4
Temporal repetition counting aims to quantify the repeated action cycles within a video. The majority of existing methods rely on the similarity correlation matrix to characterize…
Social Motion Prediction with Cognitive Hierarchies
Wentao Zhu, Jason Qin, Yuke Lou +4
Humans exhibit a remarkable capacity for anticipating the actions of others and planning their own actions accordingly. In this study, we strive to replicate this ability by addres…
Human Motion Generation: A Survey
Wentao Zhu, Xiaoxuan Ma, Dongwoo Ro +6
Human motion generation aims to generate natural human pose sequences and shows immense potential for real-world applications. Substantial progress has been made recently in motion…
Proactive Multi-Camera Collaboration For 3D Human Pose Estimation
Hai Ci, Mickel Liu, Xuehai Pan +2
This paper presents a multi-agent reinforcement learning (MARL) scheme for proactive Multi-Camera Collaboration in 3D Human Pose Estimation in dynamic human crowds. Traditional fix…
GFPose: Learning 3D Human Pose Prior with Gradient Fields
Hai Ci, Mingdong Wu, Wentao Zhu +4
Learning 3D human pose prior is essential to human-centered AI. Here, we present GFPose, a versatile framework to model plausible 3D human poses for various applications. At the co…
Context Modeling in 3D Human Pose Estimation: A Unified Perspective
Xiaoxuan Ma, Jiajun Su, Chunyu Wang +2
Estimating 3D human pose from a single image suffers from severe ambiguity since multiple 3D joint configurations may have the same 2D projection. The state-of-the-art methods ofte…