105 citations · 139 across the 46 of their papers we have counts for
46 papers · 1 filter
Towards Reconstructing Geographically Diverse Architecture with 3D Foundation Models
Nicky Kriplani, Yiwen Zhang, Angelina Wang +1
Internet-scale photo collections of real-world landmarks have driven progress in 3D computer vision yet remain highly challenging for modern 3D foundation models (3DFMs) that estim…
Learning to Read the Contextual Tokens in Diffusion Transformers
Omer Dahary, Etai Sella, Hadar Averbuch-Elor +2
Multimodal Diffusion Transformers (MM-DiTs) jointly process visual and textual representations throughout generation. These models repeatedly update the text tokens through multimo…
MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generation
Yiwen Zhang, Haocheng Xi, Michael Tian-Yue Liu +4
Long-horizon autoregressive video generation is limited by a finite context window. When an object or scene falls out of context, its fine-grained visual details may be lost and di…
NAMESAKES: Probing Identity Memorization in Text-to-Image Models
Morris Alper, Vasudha Varadarajan, Moran Yanuka +2
Text-to-image (T2I) models generate realistic likenesses of some individuals when prompted with their names, raising privacy concerns. However, distinguishing whether a generated f…
Latent-Identity Tuning in Text-to-Image Personalization Models
Daniel Garibi, Ronen Kamenetsky, Hadar Averbuch-Elor +2
Generating and editing a person's face demands high precision, as even minor modifications can significantly alter a subject's perceived identity. Current personalization and editi…
MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcing
Gal Fiebelman, Hadar Averbuch-Elor, Sagie Benaim
Recent advances in video diffusion models have enabled either long single-view generation through temporal autoregression, or short multi-view synthesis through bidirectional atten…
Long-tail Internet photo reconstruction
Yuan Li, Yuanbo Xiangli, Hadar Averbuch-Elor +2
Internet photo collections exhibit an extremely long-tailed distribution: a few famous landmarks are densely photographed and easily reconstructed in 3D, while most real-world site…
Scene Grounding In the Wild
Tamir Cohen, Leo Segre, Shay Shomer-Chai +2
Reconstructing accurate 3D models of large-scale real-world scenes from unstructured, in-the-wild imagery remains a core challenge in computer vision, especially when the input vie…
Lang3D-XL: Language Embedded 3D Gaussians for Large-scale Scenes
Shai Krakovsky, Gal Fiebelman, Sagie Benaim +1
Embedding a language field in a 3D representation enables richer semantic understanding of spatial environments by linking geometry with descriptive meaning. This allows for a more…
Emergent Extreme-View Geometry in 3D Foundation Models
Yiwen Zhang, Joseph Tung, Ruojin Cai +2
3D foundation models (3DFMs) have recently transformed 3D vision, enabling joint prediction of depths, poses, and point maps directly from images. Yet their ability to reason under…
Color Bind: Exploring Color Perception in Text-to-Image Models
Shay Shomer-Chai, Wenxuan Peng, Bharath Hariharan +1
Text-to-image generation has recently seen remarkable success, granting users with the ability to create high-quality images through the use of text. However, contemporary methods…
Supercharging Floorplan Localization with Semantic Rays
Yuval Grader, Hadar Averbuch-Elor
Floorplans provide a compact representation of the building's structure, revealing not only layout information but also detailed semantics such as the locations of windows and door…
WildCAT3D: Appearance-Aware Multi-View Diffusion in the Wild
Morris Alper, David Novotny, Filippos Kokkinos +2
Despite recent advances in sparse novel view synthesis (NVS) applied to object-centric scenes, scene-level NVS remains a challenge. A central issue is the lack of available clean m…
InstanceGen: Image Generation with Instance-level Instructions
Etai Sella, Yanir Kleiman, Hadar Averbuch-Elor
Despite rapid advancements in the capabilities of generative models, pretrained text-to-image models still struggle in capturing the semantics conveyed by complex prompts that comp…
ProtoSnap: Prototype Alignment for Cuneiform Signs
Rachel Mikulinsky, Morris Alper, Shai Gordin +3
The cuneiform writing system served as the medium for transmitting knowledge in the ancient Near East for a period of over three thousand years. Cuneiform signs have a complex inte…
Dynamic Scene Understanding from Vision-Language Representations
Shahaf Pruss, Morris Alper, Hadar Averbuch-Elor
Images depicting complex, dynamic scenes are challenging to parse automatically, requiring both high-level comprehension of the overall situation and fine-grained identification of…
WAFFLE: Multimodal Floorplan Understanding in the Wild
Keren Ganon, Morris Alper, Rachel Mikulinsky +1
Buildings are a central feature of human culture and are increasingly being analyzed with computational methods. However, recent works on computational building understanding have…
Extreme Rotation Estimation in the Wild
Hana Bezalel, Dotan Ankri, Ruojin Cai +1
We present a technique and benchmark dataset for estimating the relative 3D orientation between a pair of Internet images captured in an extreme setting, where the images have limi…
4-LEGS: 4D Language Embedded Gaussian Splatting
Gal Fiebelman, Tamir Cohen, Ayellet Morgenstern +2
The emergence of neural representations has revolutionized our means for digitally viewing a wide range of 3D scenes, enabling the synthesis of photorealistic images rendered from…
Emergent Visual-Semantic Hierarchies in Image-Text Representations
Morris Alper, Hadar Averbuch-Elor
While recent vision-and-language models (VLMs) like CLIP are a powerful tool for analyzing text and images in a shared semantic space, they do not explicitly model the hierarchical…
HaLo-NeRF: Learning Geometry-Guided Semantics for Exploring Unconstrained Photo Collections
Chen Dudai, Morris Alper, Hana Bezalel +3
Internet image collections containing photos captured by crowds of photographers show promise for enabling digital exploration of large-scale tourist landmarks. However, prior work…
ReNoise: Real Image Inversion Through Iterative Noising
Daniel Garibi, Or Patashnik, Andrey Voynov +2
Recent advancements in text-guided diffusion models have unlocked powerful image manipulation capabilities. However, applying these methods to real images necessitates the inversio…
Mitigating Open-Vocabulary Caption Hallucinations
Assaf Ben-Kish, Moran Yanuka, Morris Alper +2
While recent years have seen rapid progress in image-conditioned text generation, image captioning still suffers from the fundamental issue of hallucinations, namely, the generatio…
Cross-Image Attention for Zero-Shot Appearance Transfer
Yuval Alaluf, Daniel Garibi, Or Patashnik +2
Recent advancements in text-to-image generative models have demonstrated a remarkable ability to capture a deep semantic understanding of images. In this work, we leverage this sem…