205 citations · 335 across the 39 of their papers we have counts for
50 papers
ViPS: Video-informed Pose Spaces for Auto-Rigged Meshes
Honglin Chen, Karran Pandey, Rundi Wu +6
Kinematic rigs provide a structured interface for articulating 3D meshes but lack any associated pose space, i.e., an explicit representation of the plausible manifold of joint con…
Faster 3D Gaussian Splatting Convergence via Structure-Aware Densification
Linjie Lyu, Ayush Tewari, Jianchun Chen +2
3D Gaussian Splatting has emerged as a powerful scene representation for real-time novel-view synthesis. However, its standard adaptive density control relies on screen-space posit…
Understanding Multi-View Transformers
Michal Stary, Julien Gaubil, Ayush Tewari +1
Multi-view transformers such as DUSt3R are revolutionizing 3D vision by solving 3D tasks in a feed-forward manner. However, contrary to previous optimization-based pipelines, the i…
Manifold Sampling for Differentiable Uncertainty in Radiance Fields
Linjie Lyu, Ayush Tewari, Marc Habermann +4
Radiance fields are powerful and, hence, popular models for representing the appearance of complex scenes. Yet, constructing them based on image observations gives rise to ambiguit…
GAURA: Generalizable Approach for Unified Restoration and Rendering of Arbitrary Views
Vinayak Gupta, Rongali Simhachala Venkata Girish, Mukund Varma T +2
Neural rendering methods can achieve near-photorealistic image synthesis of scenes from posed input images. However, when the images are imperfect, e.g., captured in very low-light…
FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descent
Cameron Smith, David Charatan, Ayush Tewari +1
This paper introduces FlowMap, an end-to-end differentiable method that solves for precise camera poses, camera intrinsics, and per-frame dense depth of a video sequence. Our metho…
Diffusion Posterior Illumination for Ambiguity-aware Inverse Rendering
Linjie Lyu, Ayush Tewari, Marc Habermann +4
Inverse rendering, the process of inferring scene properties from images, is a challenging inverse problem. The task is ill-posed, as many different scene configurations can give r…
Approaching human 3D shape perception with neurally mappable models
Thomas P. O'Connell, Tyler Bonnen, Yoni Friedman +4
Humans effortlessly infer the 3D shape of objects. What computations underlie this ability? Although various computational models have been proposed, none of them capture the human…
AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars
Mohit Mendiratta, Xingang Pan, Mohamed Elgharib +6
Capturing and editing full head performances enables the creation of virtual characters with various applications such as extended reality and media production. The past few years…
Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision
Ayush Tewari, Tianwei Yin, George Cazenavette +5
Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenario…
FlowCam: Training Generalizable 3D Radiance Fields without Camera Poses via Pixel-Aligned Scene Flow
Cameron Smith, Yilun Du, Ayush Tewari +1
Reconstruction of 3D neural fields from posed images has emerged as a promising method for self-supervised representation learning. The key challenge preventing the deployment of t…
Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold
Xingang Pan, Ayush Tewari, Thomas Leimkühler +3
Synthesizing visual content that meets users' needs often requires flexible and precise controllability of the pose, shape, expression, and layout of the generated objects. Existin…
Learning to Render Novel Views from Wide-Baseline Stereo Pairs
Yilun Du, Cameron Smith, Ayush Tewari +1
We introduce a method for novel view synthesis given only a single wide-baseline stereo image pair. In this challenging regime, 3D scene points are regularly observed only once, re…
ConceptFusion: Open-set Multimodal 3D Mapping
Krishna Murthy Jatavallabhula, Alihusein Kuwajerwala, Qiao Gu +14
Building 3D maps of the environment is central to robot navigation, planning, and interaction with objects in a scene. Most existing approaches that integrate semantic concepts wit…
gCoRF: Generative Compositional Radiance Fields
Mallikarjun BR, Ayush Tewari, Xingang Pan +2
3D generative models of objects enable photorealistic image synthesis with 3D control. Existing methods model the scene as a global scene representation, ignoring the compositional…
Generalized metric tree arrangements and Dressians
Ayush Kumar Tewari
Metric trees and metric tree arrangements index cones in the polyhedral fan structure in the Dressian and respectively. We introduce the notion of generalized m…
Neural Radiance Transfer Fields for Relightable Novel-view Synthesis with Global Illumination
Linjie Lyu, Ayush Tewari, Thomas Leimkuehler +2
Given a set of images of a scene, the re-rendering of this scene from novel views and lighting conditions is an important and challenging problem in Computer Vision and Graphics. O…
Neural Groundplans: Persistent Neural Scene Representations from a Single Image
Prafull Sharma, Ayush Tewari, Yilun Du +7
We present a method to map 2D image observations of a scene to a persistent 3D scene representation, enabling novel view synthesis and disentangled representation of the movable an…
GAN2X: Non-Lambertian Inverse Rendering of Image GANs
Xingang Pan, Ayush Tewari, Lingjie Liu +1
2D images are observations of the 3D physical world depicted with the geometry, material, and illumination components. Recovering these underlying intrinsic components from 2D imag…
Disentangled3D: Learning a 3D Generative Model with Disentangled Geometry and Appearance from Monocular Images
Ayush Tewari, Mallikarjun B R, Xingang Pan +3
Learning 3D generative models from a dataset of monocular images enables self-supervised 3D reasoning and controllable synthesis. State-of-the-art 3D generative models are GANs whi…
Characterization of tropical planar curves up to genus six
Ayush Kumar Tewari
We provide new forbidden criterion for realizability of smooth tropical plane curves. This in turn provides us a complete classification of smooth tropical plane curves up to genus…
FIRe: Fast Inverse Rendering using Directional and Signed Distance Functions
Tarun Yenamandra, Ayush Tewari, Nan Yang +3
Neural 3D implicit representations learn priors that are useful for diverse applications, such as single- or multiple-view 3D reconstruction. A major downside of existing approache…
Fundamental Theorem of Projective Geometry over Semirings
Ayush Kumar Tewari
We state the fundamental theorem of projective geometry for semimodules over semirings, which is facilitated by recent work in the study of bases in semimodules defined over semiri…
Egocentric Videoconferencing
Mohamed Elgharib, Mohit Mendiratta, Justus Thies +5
We introduce a method for egocentric videoconferencing that enables hands-free video calls, for instance by people wearing smart glasses or other mixed-reality devices. Videoconfer…