51 citations · 206 across the 22 of their papers we have counts for
23 papers
TimeWalker: Personalized Neural Space for Lifelong Head Avatars
Dongwei Pan, Yang Li, Hongsheng Li +1
We present TimeWalker, a novel framework that models realistic, full-scale 3D head avatars of a person on lifelong scale. Unlike current human head avatar pipelines that capture id…
Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior
Fan Lu, Kwan-Yee Lin, Yan Xu +3
Text-to-3D generation has achieved remarkable success via large-scale text-to-image diffusion models. Nevertheless, there is no paradigm for scaling up the methodology to urban sca…
CosmicMan: A Text-to-Image Foundation Model for Humans
Shikai Li, Jianglin Fu, Kaiyuan Liu +3
We present CosmicMan, a text-to-image foundation model specialized for generating high-fidelity human images. Unlike current general-purpose foundation models that are stuck in the…
Parameterization-driven Neural Surface Reconstruction for Object-oriented Editing in Neural Rendering
Baixin Xu, Jiangbei Hu, Fei Hou +4
The advancements in neural rendering have increased the need for techniques that enable intuitive editing of 3D objects represented as neural implicit surfaces. This paper introduc…
UnitedHuman: Harnessing Multi-Source Data for High-Resolution Human Generation
Jianglin Fu, Shikai Li, Yuming Jiang +3
Human generation has achieved significant progress. Nonetheless, existing methods still struggle to synthesize specific regions such as faces and hands. We argue that the main reas…
Urban Radiance Field Representation with Deformable Neural Mesh Primitives
Fan Lu, Yan Xu, Guang Chen +3
Neural Radiance Fields (NeRFs) have achieved great success in the past few years. However, most current methods still require intensive resources due to ray marching-based renderin…
DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Rendering
Wei Cheng, Ruixiang Chen, Wanqi Yin +18
Realistic human-centric rendering plays a key role in both computer vision and computer graphics. Rapid progress has been made in the algorithm aspect over the years, yet existing…
RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars
Dongwei Pan, Long Zhuo, Jingtan Piao +13
Synthesizing high-fidelity head avatars is a central problem for computer vision and graphics. While head avatar synthesis algorithms have advanced rapidly, the best ones still fac…
MonoHuman: Animatable Human Neural Field from Monocular Video
Zhengming Yu, Wei Cheng, Xian Liu +2
Animating virtual avatars with free-view control is crucial for various applications like virtual reality and digital entertainment. Previous studies have attempted to utilize the…
Deformable Model-Driven Neural Rendering for High-Fidelity 3D Reconstruction of Human Heads Under Low-View Settings
Baixin Xu, Jiarui Zhang, Kwan-Yee Lin +2
Reconstructing 3D human heads in low-view settings presents technical challenges, mainly due to the pronounced risk of overfitting with limited views and high-frequency signals. To…
StyleGAN-Human: A Data-Centric Odyssey of Human Generation
Jianglin Fu, Shikai Li, Yuming Jiang +5
Unconditional human image generation is an important task in vision and graphics, which enables various applications in the creative industry. Existing studies in this field mainly…
Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis
Wei Cheng, Su Xu, Jingtan Piao +4
This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers, only requiring a sparse number of camera views as in…
Simulating Fluids in Real-World Still Images
Siming Fan, Jingtan Piao, Chen Qian +2
In this work, we tackle the problem of real-world fluid animation from a still image. The key of our system is a surface-based layered representation deriving from video decomposit…
Learning a Structured Latent Space for Unsupervised Point Cloud Completion
Yingjie Cai, Kwan-Yee Lin, Chao Zhang +3
Unsupervised point cloud completion aims at estimating the corresponding complete point cloud of a partial point cloud in an unpaired manner. It is a crucial but challenging proble…
Inverting Generative Adversarial Renderer for Face Reconstruction
Jingtan Piao, Keqiang Sun, KwanYee Lin +2
Given a monocular face image as input, 3D face geometry reconstruction aims to recover a corresponding 3D face mesh. Recently, both optimization-based and learning-based face recon…
Semantic Scene Completion via Integrating Instances and Scene in-the-Loop
Yingjie Cai, Xuesong Chen, Chao Zhang +3
Semantic Scene Completion aims at reconstructing a complete 3D scene with precise voxel-wise semantics from a single-view depth or RGBD image. It is a crucial but challenging probl…
SelfVoxeLO: Self-supervised LiDAR Odometry with Voxel-based Deep Neural Networks
Yan Xu, Zhaoyang Huang, Kwan-Yee Lin +5
Recent learning-based LiDAR odometry methods have demonstrated their competitiveness. However, most methods still face two substantial challenges: 1) the 2D projection representati…
Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentation
Xiaokang Chen, Kwan-Yee Lin, Jingbo Wang +4
Depth information has proven to be a useful cue in the semantic segmentation of RGB-D images for providing a geometric counterpart to the RGB representation. Most existing works si…
3D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Prior
Xiaokang Chen, Kwan-Yee Lin, Chen Qian +2
The goal of the Semantic Scene Completion (SSC) task is to simultaneously predict a completed 3D voxel representation of volumetric occupancy and semantic labels of objects in the…
TRB: A Novel Triplet Representation for Understanding 2D Human Body
Haodong Duan, KwanYee Lin, Sheng Jin +3
Human pose and shape are two important components of 2D human body. However, how to efficiently represent both of them in images is still an open question. In this paper, we propos…
Make a Face: Towards Arbitrary High Fidelity Face Manipulation
Shengju Qian, Kwan-Yee Lin, Wayne Wu +5
Recent studies have shown remarkable success in face manipulation task with the advance of GANs and VAEs paradigms, but the outputs are sometimes limited to low-resolution and lack…
Weakly-Supervised Discovery of Geometry-Aware Representation for 3D Human Pose Estimation
Xipeng Chen, Kwan-Yee Lin, Wentao Liu +3
Recent studies have shown remarkable advances in 3D human pose estimation from monocular images, with the help of large-scale in-door 3D datasets and sophisticated network architec…
Hallucinated-IQA: No-Reference Image Quality Assessment via Adversarial Learning
Kwan-Yee Lin, Guanxiang Wang
No-reference image quality assessment (NR-IQA) is a fundamental yet challenging task in low-level computer vision community. The difficulty is particularly pronounced for the limit…