Differentiable Rendering: A Survey
arXiv:2006.12057
Abstract
Deep neural networks (DNNs) have shown remarkable performance improvements on vision-related tasks such as object detection or image segmentation. Despite their success, they generally lack the understanding of 3D objects which form the image, as it is not always possible to collect 3D information about the scene or to easily annotate it. Differentiable rendering is a novel field which allows the gradients of 3D objects to be calculated and propagated through images. It also reduces the requirement of 3D data collection and annotation, while enabling higher success rate in various applications. This paper reviews existing literature and discusses the current state of differentiable rendering, its applications and open research problems.
References in corpus (9)
- Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
- Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction
- Learning to Infer Implicit Surfaces without 3D Supervision
- Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Research
- GResNet: Graph Residual Network for Reviving Deep GNNs from Suspended Animation
- Pix2Vex: Image-to-Geometry Reconstruction using a Smooth Differentiable Renderer
- GEOMetrics: Exploiting Geometric Structure for Graph-Encoded Objects
- Cerberus: A Multi-headed Derenderer
- Robust Point Light Source Estimation Using Differentiable Rendering