472 citations · 624 across the 37 of their papers we have counts for
13 papers · 1 filter
Stuck on Shuffle: On Attribute-Object Binding in Vision-Language Models
Netanel Y. Tamir, Michael Green, Issar Tzachor +4
Retrieval is a fundamental task in multimodal systems: given an image or text query, the goal is to find the most relevant images or texts in a collection, often using a shared emb…
Learning to Read the Contextual Tokens in Diffusion Transformers
Omer Dahary, Etai Sella, Hadar Averbuch-Elor +2
Multimodal Diffusion Transformers (MM-DiTs) jointly process visual and textual representations throughout generation. These models repeatedly update the text tokens through multimo…
Analysis-by-Proxy: Localization Signals in VLMs Operating as Condition Encoders
Yoav Baron, Sara Dorfman, Roni Paiss +2
Vision-Language Models (VLMs) are increasingly utilized as the conditioning backbone for diffusion-based image editing due to their remarkable multimodal reasoning capabilities. Wh…
Token-to-Token Alignment of Text Embeddings for Semantic Blending
Saar Huberman, Ron Mokady, Or Patashnik +1
In modern generative models, images are specified and controlled through text prompts. In practice, images are generated from sequences of tokens derived from these prompts. Howeve…
Keep The Essentials: Efficient Reference Conditioned Generation via Token Dropping
Rishubh Parihar, Ayush Raina, R. Venkatesh Babu +1
Reference-based diffusion models enable highly controllable image generation by leveraging elements from input images to guide prompt-driven synthesis. However, these models are co…
Semantic Browsing: Controllable Diversity for Image Generation
Sara Dorfman, Maya Vishnevsky, Omer Dahary +2
Modern text-to-image models excel in visual fidelity and prompt adherence. However, this strict adherence comes at the cost of diversity: generated samples tend to collapse into a…
Reference-Driven Multi-Speaker Audio Scene Generation from In-the-Wild Priors
Michael Finkelson, Daniel Segal, Eitan Richardson +7
Existing multi-speaker dialogue systems bind speakers to utterances through structured supervision: per-turn tags, multi-stream transcriptions, or learnable speaker embeddings. The…
Prox-E: Fine-Grained 3D Shape Editing via Primitive-Based Abstractions
Etai Sella, Hao Phung, Nitay Amiel +3
Text-based 2D image editing models have recently reached an impressive level of maturity, motivating a growing body of work that heavily depends on these models to drive 3D edits.…
ParetoSlider: Diffusion Models Post-Training for Continuous Reward Control
Shelly Golan, Michael Finkelson, Ariel Bereslavsky +2
Reinforcement Learning (RL) post-training has become the standard for aligning generative models with human preferences, yet most methods rely on a single scalar reward. When multi…
HDR Video Generation via Latent Alignment with Logarithmic Encoding
Naomi Ken Korem, Mohamed Oumoumad, Harel Cain +8
High dynamic range (HDR) imagery offers a rich and faithful representation of scene radiance, but remains challenging for generative models due to its mismatch with the bounded, pe…
Untwisting RoPE: Frequency Control for Shared Attention in DiTs
Aryan Mikaeili, Or Patashnik, Andrea Tagliasacchi +2
Positional encodings are essential to transformer-based generative models, yet their behavior in multimodal and attention-sharing settings is not fully understood. In this work, we…
JUST-DUB-IT: Video Dubbing via Joint Audio-Visual Diffusion
Anthony Chen, Naomi Ken Korem, Gal Zeevi +6
Audio-Visual Foundation Models, which are pretrained to jointly generate sound and visual content, have recently shown an unprecedented ability to model multi-modal generation and…
LooseRoPE: Content-aware Attention Manipulation for Semantic Harmonization
Etai Sella, Yoav Baron, Hadar Averbuch-Elor +2
Recent diffusion-based image editing methods commonly rely on text or high-level instructions to guide the generation process, offering intuitive but coarse control. In contrast, w…