51 citations · 138 across the 36 of their papers we have counts for
42 papers
TKCAM: Text and Keyframe to Camera Trajectory Generation
Haozhe Yang, Zhiyang Dou, Zekai Gu +4
Generating high-quality and controllable camera motion is essential for AI-assisted cinematography, video synthesis, and 3D scene understanding. We introduce TKCAM, a Text- and Key…
TrackFish3D: Self-Supervised 3D Tracking of Schooling Fish from Multi-view Videos
Patt Phurtivilai, Zhiyang Dou, Yifan Wu +5
Quantifying collective fish behavior requires accurate trajectories, yet multi-view 3D tracking remains challenging due to frequent occlusions, visually similar individuals, and th…
MoSAT: Human Motion Generation from Spatial Audio and Textual Description
Shuyang Xu, Zhiyang Dou, Yiduo Hao +8
Human motion is shaped by both external acoustic events and behavioral intent: spatial audio conveys environmental cues that elicit or guide a response, while text specifies the de…
Strips as Tokens: Artist Mesh Generation with Native UV Segmentation
Rui Xu, Dafei Qin, Kaichun Qiao +8
Recent advancements in autoregressive transformers have demonstrated remarkable potential for generating artist-quality meshes. However, the token ordering strategies employed by e…
SAND: Spatially Adaptive Network Depth for Fast Sampling of Neural Implicit Surfaces
Chuanxiang Yang, Junhui Hou, Yuan Liu +5
Implicit neural representations are powerful for geometric modeling, but their practical use is often limited by the high computational cost of network evaluations. We observe that…
UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animation
Chengfeng Zhao, Junbo Qi, Yulou Liu +6
Simulating physically realistic garment deformations is an essential task for virtual immersive experience, which is often achieved by physics simulation methods. However, these me…
EgoReAct: Egocentric Video-Driven 3D Human Reaction Generation
Libo Zhang, Zekun Li, Tianyu Li +10
Humans exhibit adaptive, context-sensitive responses to egocentric visual input. However, faithfully modeling such reactions from egocentric video remains challenging due to the du…
MATStruct: High-Quality Medial Mesh Computation via Structure-aware Variational Optimization
Ningna Wang, Rui Xu, Yibo Yin +4
We propose a novel optimization framework for computing the medial axis transform that simultaneously preserves the medial structure and ensures high medial mesh quality. The media…
MeshMosaic: Scaling Artist Mesh Generation via Local-to-Global Assembly
Rui Xu, Tianyang Xue, Qiujie Dong +9
Scaling artist-designed meshes to high triangle numbers remains challenging for autoregressive generative models. Existing transformer-based methods suffer from long-sequence bottl…
Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondence
Ling-Hao Chen, Yuhong Zhang, Zixin Yin +5
This work studies the challenge of transfer animations between characters whose skeletal topologies differ substantially. While many techniques have advanced retargeting techniques…
PDT: Point Distribution Transformation with Diffusion Models
Jionghao Wang, Cheng Lin, Yuan Liu +7
Point-based representations have consistently played a vital role in geometric data structures. Most point cloud learning and processing methods typically leverage the unordered an…
MOSPA: Human Motion Generation Driven by Spatial Audio
Shuyang Xu, Zhiyang Dou, Mingyi Shi +8
Enabling virtual humans to dynamically and realistically respond to diverse auditory stimuli remains a key challenge in character animation, demanding the integration of perceptual…
CrossGen: Learning and Generating Cross Fields for Quad Meshing
Qiujie Dong, Jiepeng Wang, Rui Xu +10
Cross fields play a critical role in various geometry processing tasks, especially for quad mesh generation. Existing methods for cross field generation often struggle to balance c…
CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objects
Huaijin Pi, Zhi Cen, Zhiyang Dou +1
Synthesizing whole-body manipulation of articulated objects, including body motion, hand motion, and object motion, is a critical yet challenging task with broad applications in vi…
TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenization
Liang Pan, Zeshi Yang, Zhiyang Dou +5
Synthesizing diverse and physically plausible Human-Scene Interactions (HSI) is pivotal for both computer animation and embodied AI. Despite encouraging progress, current methods m…
SDRS: Shape-Differentiable Robot Simulator
Xiaohan Ye, Xifeng Gao, Kui Wu +2
Robot simulators are indispensable tools across many fields, and recent research has significantly improved their functionality by incorporating additional gradient information. Ho…
RMD: A Simple Baseline for More General Human Motion Generation via Training-free Retrieval-Augmented Motion Diffuse
Zhouyingcheng Liao, Mingyuan Zhang, Wenjia Wang +2
While motion generation has made substantial progress, its practical application remains constrained by dataset diversity and scale, limiting its ability to handle out-of-distribut…
GausSurf: Geometry-Guided 3D Gaussian Splatting for Surface Reconstruction
Jiepeng Wang, Yuan Liu, Peng Wang +5
3D Gaussian Splatting has achieved impressive performance in novel view synthesis with real-time rendering capabilities. However, reconstructing high-quality surfaces with fine det…
Motion-2-To-3: Leveraging 2D Motion Data for 3D Motion Generations
Ruoxi Guo, Huaijin Pi, Zehong Shen +8
Text-driven human motion synthesis has showcased its potential for revolutionizing motion design in the movie and game industry. Existing methods often rely on 3D motion capture da…
Facial Surgery Preview Based on the Orthognathic Treatment Prediction
Huijun Han, Congyi Zhang, Lifeng Zhu +6
Orthognathic surgery consultation is essential to help patients understand the changes to their facial appearance after surgery. However, current visualization methods are often in…
MotionWavelet: Human Motion Prediction via Wavelet Manifold Learning
Yuming Feng, Zhiyang Dou, Ling-Hao Chen +7
Modeling temporal characteristics and the non-stationary dynamics of body movement plays a significant role in predicting human future motions. However, it is challenging to captur…
SIMS: Simulating Stylized Human-Scene Interactions with Retrieval-Augmented Script Generation
Wenjia Wang, Liang Pan, Zhiyang Dou +7
Simulating stylized human-scene interactions (HSI) in physical environments is a challenging yet fascinating task. Prior works emphasize long-term execution but fall short in achie…
SVGS: Enhancing Gaussian Splatting Using Primitives with Spatially Varying Colors
Rui Xu, Wenyue Chen, Jiepeng Wang +7
Gaussian Splatting demonstrates impressive results in multi-view reconstruction based on Gaussian explicit representations. However, the current Gaussian primitives only have a sin…
An Eulerian Vortex Method on Flow Maps
Sinan Wang, Yitong Deng, Molin Deng +6
We present an Eulerian vortex method based on the theory of flow maps to simulate the complex vortical motions of incompressible fluids. Central to our method is the novel incorpor…