9 papers
AssemblyWorld: Rethinking 3D Assembly with General-Purpose Agents
Jiahao Zhang, Yeying Fan, Moitreya Chatterjee +5
The task of 3D assembly requires translating an understanding of parts and their relationships into precise spatial arrangements. Can pretrained general-purpose agents assemble obj…
AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects
Danrui Li, Jiahao Zhang, Bernhard Egger +4
Assembling objects from parts requires understanding multimodal instructions, linking them to 3D components, and predicting physically plausible 6-DoF motions for each assembly ste…
FreBIS: Frequency-Based Stratification for Neural Implicit Surface Representations
Naoko Sawada, Pedro Miraldo, Suhas Lohit +2
Neural implicit surface representation techniques are in high demand for advancing technologies in augmented reality/virtual reality, digital twins, autonomous navigation, and many…
Multimodal Diffusion Bridge with Attention-Based SAR Fusion for Satellite Image Cloud Removal
Yuyang Hu, Suhas Lohit, Ulugbek S. Kamilov +1
Deep learning has achieved some success in addressing the challenge of cloud removal in optical satellite images, by fusing with synthetic aperture radar (SAR) images. Recently, di…
Time-Series U-Net with Recurrence for Noise-Robust Imaging Photoplethysmography
Vineet R. Shenoy, Shaoju Wu, Armand Comas +3
Remote estimation of vital signs enables health monitoring for situations in which contact-based devices are either not available, too intrusive, or too expensive. In this paper, w…
Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models
Vineet R Shenoy, Suhas Lohit, Hassan Mansour +2
Camera-based monitoring of vital signs, also known as imaging photoplethysmography (iPPG), has seen applications in driver-monitoring, perfusion assessment in surgical settings, af…
Disentangled Acoustic Fields For Multimodal Physical Scene Understanding
Jie Yin, Andrew Luo, Yilun Du +4
We study the problem of multimodal physical scene understanding, where an embodied agent needs to find fallen objects by inferring object properties, direction, and distance of an…
TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Models
Haomiao Ni, Bernhard Egger, Suhas Lohit +5
Text-conditioned image-to-video generation (TI2V) aims to synthesize a realistic video starting from a given image (e.g., a woman's photo) and a text description (e.g., "a woman is…
Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis
Nithin Gopalakrishnan Nair, Anoop Cherian, Suhas Lohit +4
Conditional generative models typically demand large annotated training sets to achieve high-quality synthesis. As a result, there has been significant interest in designing models…