3 citations · 10 across the 27 of their papers we have counts for
31 papers
AssetGen: Deployable 3D Asset Generation at Interactive Speed
Dilin Wang, Xiaoyu Xiang, Kihyuk Sohn +14
While 3D generation is progressing rapidly, recent work has often focused on obtaining high-resolution assets, leaving user experience and deployability as afterthoughts. We presen…
HyperBones: Realtime Bone-driven Neural Garment Simulation with Hypernetwork Conditioning
Astitva Srivastava, Hsiao-Yu Chen, Ryan Goldade +8
Recent advances in cloth simulation have led to accurate garment physics, but the methods are computationally expensive for real-time applications. In contrast, Linear Blend Skinni…
PhySkin: Physics-based Bone-driven Neural Garment Simulation
Astitva Srivastava, Hsiao-yu Chen, Ryan Goldade +7
Recent advances in digital avatar technology have enabled the generation of compelling virtual characters, but deploying these avatars on compute-constrained devices poses signific…
WorldGen: From Text to Traversable and Interactive 3D Worlds
Dilin Wang, Hyunyoung Jung, Tom Monnier +22
We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts. Our approach transforms natural language descr…
PGC: Physics-Based Gaussian Cloth from a Single Pose
Michelle Guo, Matt Jen-Yuan Chiang, Igor Santesteban +9
We introduce a novel approach to reconstruct simulation-ready garments with intricate appearance. Despite recent advancements, existing methods often struggle to balance the need f…
UVGS: Reimagining Unstructured 3D Gaussian Splatting using UV Mapping
Aashish Rai, Dilin Wang, Mihir Jain +4
3D Gaussian Splatting (3DGS) has demonstrated superior quality in modeling 3D objects and scenes. However, generating 3DGS remains challenging due to their discrete, unstructured,…
Quaffure: Real-Time Quasi-Static Neural Hair Simulation
Tuur Stuyck, Gene Wei-Chin Lin, Egor Larionov +4
Realistic hair motion is crucial for high-quality avatars, but it is often limited by the computational resources available for real-time applications. To address this challenge, w…
3D Mesh Editing using Masked LRMs
Will Gao, Dilin Wang, Yuchen Fan +6
We present a novel approach to shape editing, building on recent progress in 3D reconstruction from multi-view images. We formulate shape editing as a conditional reconstruction pr…
WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians
Dmytro Kotovenko, Olga Grebenkova, Nikolaos Sarafianos +8
While style transfer techniques have been well-developed for 2D image stylization, the extension of these methods to 3D scenes remains relatively unexplored. Existing approaches de…
TalkinNeRF: Animatable Neural Fields for Full-Body Talking Humans
Aggelina Chatziagapi, Bindita Chaudhuri, Amit Kumar +3
We introduce a novel framework that learns a dynamic neural radiance field (NeRF) for full-body talking humans from monocular videos. Prior work represents only the body pose or th…
ANIM: Accurate Neural Implicit Model for Human Reconstruction from a single RGB-D image
Marco Pesavento, Yuanlu Xu, Nikolaos Sarafianos +7
Recent progress in human shape learning, shows that neural implicit models are effective in generating 3D human surfaces from limited number of views, and even from a single RGB im…
Garment3DGen: 3D Garment Stylization and Texture Generation
Nikolaos Sarafianos, Tuur Stuyck, Xiaoyu Xiang +3
We introduce Garment3DGen a new method to synthesize 3D garment assets from a base mesh given a single input image as guidance. Our proposed approach allows users to generate 3D te…
Geometry Transfer for Stylizing Radiance Fields
Hyunyoung Jung, Seonghyeon Nam, Nikolaos Sarafianos +3
Shape and geometric patterns are essential in defining stylistic identity. However, current 3D style transfer methods predominantly focus on transferring colors and textures, often…
HISR: Hybrid Implicit Surface Representation for Photorealistic 3D Human Reconstruction
Angtian Wang, Yuanlu Xu, Nikolaos Sarafianos +4
Neural reconstruction and rendering strategies have demonstrated state-of-the-art performances due, in part, to their ability to preserve high level shape details. Existing approac…
DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulation
Yifei Li, Hsiao-yu Chen, Egor Larionov +3
The realism of digital avatars is crucial in enabling telepresence applications with self-expression and customization. While physical simulations can produce realistic motions for…
NSF: Neural Surface Fields for Human Modeling from Monocular Depth
Yuxuan Xue, Bharat Lal Bhatnagar, Riccardo Marin +4
Obtaining personalized 3D animatable avatars from a monocular camera has several real world applications in gaming, virtual try-on, animation, and VR/XR, etc. However, it is very c…
VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANs
Anna Frühstück, Nikolaos Sarafianos, Yuanlu Xu +2
We introduce VIVE3D, a novel approach that extends the capabilities of image-based 3D GANs to video editing and is able to represent the input video in an identity-preserving and t…
Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fields
Garvita Tiwari, Dimitrije Antic, Jan Eric Lenssen +3
We present Pose-NDF, a continuous model for plausible human poses based on neural distance fields (NDFs). Pose or motion priors are important for generating realistic new poses and…
BodyMap: Learning Full-Body Dense Correspondence Map
Anastasia Ianina, Nikolaos Sarafianos, Yuanlu Xu +2
Dense correspondence between humans carries powerful semantic information that can be utilized to solve fundamental problems for full-body understanding such as in-the-wild surface…
Neural Rendering of Humans in Novel View and Pose from Monocular Video
Tiantian Wang, Nikolaos Sarafianos, Ming-Hsuan Yang +1
We introduce a new method that generates photo-realistic humans under novel views and poses given a monocular video as input. Despite the significant progress recently on this topi…
SPAMs: Structured Implicit Parametric Models
Pablo Palafox, Nikolaos Sarafianos, Tony Tung +1
Parametric 3D models have formed a fundamental role in modeling deformable objects, such as human bodies, faces, and hands; however, the construction of such parametric models requ…
Free-Viewpoint RGB-D Human Performance Capture and Rendering
Phong Nguyen-Ha, Nikolaos Sarafianos, Christoph Lassner +2
Capturing and faithfully rendering photo-realistic humans from novel views is a fundamental problem for AR/VR applications. While prior work has shown impressive performance captur…
Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothing
Garvita Tiwari, Nikolaos Sarafianos, Tony Tung +1
We present Neural Generalized Implicit Functions(Neural-GIF), to animate people in clothing as a function of the body pose. Given a sequence of scans of a subject in various poses,…
Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humans
Bindita Chaudhuri, Nikolaos Sarafianos, Linda Shapiro +1
We introduce a novel approach to generate diverse high fidelity texture maps for 3D human meshes in a semi-supervised setup. Given a segmentation mask defining the layout of the se…