Dr.Jit: A Just-In-Time Compiler for Differentiable Rendering

Abstract

Dr$.$Jit is a new just-in-time compiler for physically based rendering and its derivative. Dr$.$Jit expedites research on these topics in two ways: first, it traces high-level simulation code (e.g., written in Python) and aggressively simplifies and specializes the resulting program representation, producing data-parallel kernels with state-of-the-art performance on CPUs and GPUs. Second, it simplifies the development of differentiable rendering algorithms. Efficient methods in this area turn the derivative of a simulation into a simulation of the derivative. Dr$.$Jit provides fine-grained control over the process of automatic differentiation to help with this transformation. Specialization is particularly helpful in the context of differentiation, since large parts of the simulation ultimately do not influence the computed gradients. Dr$.$Jit tracks data dependencies globally to find and remove redundant computation.

To appear at SIGGRAPH 2022

Cited by in corpus (11)

• Toward Real-Time Digital Twins of EM Environments: Computational Benchmark of Ray Launching Software
• Gradient descent-based freeform optics design using algorithmic differentiable non-sequential ray tracing
• N-Dimensional Gaussians for Fitting of High Dimensional Functions
• A Modularized Design Approach for GelSight Family of Vision-based Tactile Sensors
• DiffRenderGAN: Addressing Training Data Scarcity in Deep Segmentation Networks for Quantitative Nanomaterial Analysis through Differentiable Rendering and Generative Modelling
• Automated design of compound lenses with discrete-continuous optimization
• DPCS: Path Tracing-Based Differentiable Projector-Camera Systems
• Neural Product Importance Sampling via Warp Composition
• SymX: Energy-based Simulation from Symbolic Expressions
• Visual Tomography: Physically Faithful Volumetric Models of Partially Translucent Objects
• Advances in Neural 3D Mesh Texturing: A Survey