43 citations · 104 across the 44 of their papers we have counts for
47 papers
Soundwich: Video Generation with Layered and Controllable Audio
Zhuo Ning, AmirHossein Naghi Razlighi, Sagi Polaczek +2
Recent joint audio-video generative models can synthesize realistic videos with synchronized sound, but typically generate audio as a single mixed track. This limits source-level c…
The Attention Triangle in Audio-Video Models
Sagi Polaczek, Noa Kraicer, Gal Metzer +4
Audio-video diffusion models rely on cross-modal attention to coordinate text, sound, and visual content, yet this same mechanism can introduce subtle and systematic semantic leaka…
RECOUNT: Reference-guided Counting with Synthetic Visual Exemplars
Adriano D'Alessandro, Ali Mahdavi-Amiri, Ghassan Hamarneh
Text-guided zero-shot object counters excel at spatial localization but categorize poorly on novel or fine-grained classes: natural language is too coarse to fully specify visual i…
HairPort: In-context 3D-aware Hair Import and Transfer for Images
Alireza Heidari, Amirhossein Alimohammadi, Ali Mahdavi-Amiri
Transferring hairstyles between images is an important but challenging task in computer graphics, computer vision, and visual effects. It enables users to explore new looks without…
Advances in Neural 3D Mesh Texturing: A Survey
Sai Raj Kishore Perla, Hao Zhang, Ali Mahdavi-Amiri
Texturing 3D meshes plays a vital role in determining the visual realism of digital objects and scenes. Although recent generative 3D approaches based on Neural Radiance Fields and…
Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects
Denys Iliash, Jiayi Liu, Egor Fokin +4
We present Artiverse, a diverse and physically grounded dataset of high-quality articulated 3D objects designed for realistic functional modeling and simulation. Artiverse contains…
Sound Sparks Motion: Audio and Text Tuning for Video Editing
AmirHossein Naghi Razlighi, Aryan Mikaeili, Ali Mahdavi-Amiri +2
Motion-centric video editing remains difficult for large generative video models, which often respond well to appearance changes but struggle to produce specific, localized actions…
Functionalization via Structure Completion and Motion Rectification
Mingrui Zhao, Sai Raj Kishore Perla, Kai Wang +8
Acquisition and creation of 3D assets have been largely view- or appearance-driven. As a result, existing digital 3D models often lack the requisite structural components to functi…
Video Analysis and Generation via a Semantic Progress Function
Gal Metzer, Sagi Polaczek, Ali Mahdavi-Amiri +2
Transformations produced by image and video generation models often evolve in a highly non-linear manner: long stretches where the content barely changes are followed by sudden, ab…
Untwisting RoPE: Frequency Control for Shared Attention in DiTs
Aryan Mikaeili, Or Patashnik, Andrea Tagliasacchi +2
Positional encodings are essential to transformer-based generative models, yet their behavior in multimodal and attention-sharing settings is not fully understood. In this work, we…
In-Context Sync-LoRA for Portrait Video Editing
Sagi Polaczek, Or Patashnik, Ali Mahdavi-Amiri +1
Editing portrait videos is a challenging task that requires flexible yet precise control over a wide range of modifications, such as appearance changes, expression edits, or the ad…
CREward: A Type-Specific Creativity Reward Model
Jiyeon Han, Ali Mahdavi-Amiri, Hao Zhang +1
Creativity is a complex phenomenon. When it comes to representing and assessing creativity, treating it as a single undifferentiated quantity would appear naive and underwhelming.…
Advances in 4D Representation: Geometry, Motion, and Interaction
Mingrui Zhao, Sauradip Nag, Kai Wang +5
We present a survey on 4D generation and reconstruction, a fast-evolving subfield of computer graphics whose developments have been propelled by recent advances in neural fields, g…
Griffin: Generative Reference and Layout Guided Image Composition
Aryan Mikaeili, Amirhossein Alimohammadi, Negar Hassanpour +2
Text-to-image models have achieved a level of realism that enables the generation of highly convincing images. However, text-based control can be a limiting factor when more explic…
ASIA: Adaptive 3D Segmentation using Few Image Annotations
Sai Raj Kishore Perla, Aditya Vora, Sauradip Nag +2
We introduce ASIA (Adaptive 3D Segmentation using few Image Annotations), a novel framework that enables segmentation of possibly non-semantic and non-text-describable "parts" in 3…
Cora: Correspondence-aware image editing using few step diffusion
Amirhossein Alimohammadi, Aryan Mikaeili, Sauradip Nag +3
Image editing is an important task in computer graphics, vision, and VFX, with recent diffusion-based methods achieving fast and high-quality results. However, edits requiring sign…
ACT-R: Adaptive Camera Trajectories for Single View 3D Reconstruction
Yizhi Wang, Mingrui Zhao, Hao Zhang
We introduce the simple idea of adaptive view planning to multi-view synthesis, aiming to improve both occlusion revelation and 3D consistency for single-view 3D reconstruction. In…
FiGO: Fine-Grained Object Counting without Annotations
Adriano D'Alessandro, Ali Mahdavi-Amiri, Ghassan Hamarneh
Class-agnostic counting (CAC) methods reduce annotation costs by letting users define what to count at test-time through text or visual exemplars. However, current open-vocabulary…
MotionBridge: Dynamic Video Inbetweening with Flexible Controls
Maham Tanveer, Yang Zhou, Simon Niklaus +4
By generating plausible and smooth transitions between two image frames, video inbetweening is an essential tool for video editing and long video synthesis. Traditional works lack…
GALA: Geometry-Aware Local Adaptive Grids for Detailed 3D Generation
Dingdong Yang, Yizhi Wang, Konrad Schindler +2
We propose GALA, a novel representation of 3D shapes that (i) excels at capturing and reproducing complex geometry and surface details, (ii) is computationally efficient, and (iii)…
SMITE: Segment Me In TimE
Amirhossein Alimohammadi, Sauradip Nag, Saeid Asgari Taghanaki +3
Segmenting an object in a video presents significant challenges. Each pixel must be accurately labelled, and these labels must remain consistent across frames. The difficulty incre…
SINGAPO: Single Image Controlled Generation of Articulated Parts in Objects
Jiayi Liu, Denys Iliash, Angel X. Chang +2
We address the challenge of creating 3D assets for household articulated objects from a single image. Prior work on articulated object creation either requires multi-view multi-sta…
SweepNet: Unsupervised Learning Shape Abstraction via Neural Sweepers
Mingrui Zhao, Yizhi Wang, Fenggen Yu +2
Shape abstraction is an important task for simplifying complex geometric structures while retaining essential features. Sweep surfaces, commonly found in human-made objects, aid in…
pOps: Photo-Inspired Diffusion Operators
Elad Richardson, Yuval Alaluf, Ali Mahdavi-Amiri +1
Text-guided image generation enables the creation of visual content from textual descriptions. However, certain visual concepts cannot be effectively conveyed through language alon…