64 citations · 306 across the 23 of their papers we have counts for
23 papers · 1 filter
Encoded but Unused: Bounding the Sources of VLM Errors
Anat Veikherman, Mor Ventura, Nitay Calderon +2
In this paper, we investigate why vision-language models (VLMs) produce errors by decomposing them into two sources: visual-representation failures, in which the visual evidence re…
Sharp-It: A Multi-view to Multi-view Diffusion Model for 3D Synthesis and Manipulation
Yiftach Edelstein, Or Patashnik, Dana Cohen-Bar +1
Advancements in text-to-image diffusion models have led to significant progress in fast 3D content creation. One common approach is to generate a set of multi-view images of an obj…
FreeAugment: Data Augmentation Search Across All Degrees of Freedom
Tom Bekor, Niv Nayman, Lihi Zelnik-Manor
Data augmentation has become an integral part of deep learning, as it is known to improve the generalization capabilities of neural networks. Since the most effective set of image…
STMPL: Human Soft-Tissue Simulation
Anton Agafonov, Lihi Zelnik-Manor
In various applications, such as virtual reality and gaming, simulating the deformation of soft tissues in the human body during interactions with external objects is essential. Tr…
Diverse Imagenet Models Transfer Better
Niv Nayman, Avram Golbert, Asaf Noy +2
A commonly accepted hypothesis is that models with higher accuracy on Imagenet perform better on other downstream tasks, leading to much research dedicated to optimizing Imagenet a…
Multi-label Classification with Partial Annotations using Class-aware Selective Loss
Emanuel Ben-Baruch, Tal Ridnik, Itamar Friedman +4
Large-scale multi-label classification datasets are commonly, and perhaps inevitably, partially annotated. That is, only a small subset of labels are annotated per sample. Differen…
PETA: Photo Albums Event Recognition using Transformers Attention
Tamar Glaser, Emanuel Ben-Baruch, Gilad Sharir +3
In recent years the amounts of personal photos captured increased significantly, giving rise to new challenges in multi-image understanding and high-level image understanding. Even…
Semantic Diversity Learning for Zero-Shot Multi-label Classification
Avi Ben-Cohen, Nadav Zamir, Emanuel Ben Baruch +2
Training a neural network model for recognizing multiple labels associated with an image, including identifying unseen labels, is challenging, especially for images that portray nu…
ImageNet-21K Pretraining for the Masses
Tal Ridnik, Emanuel Ben-Baruch, Asaf Noy +1
ImageNet-1K serves as the primary dataset for pretraining deep learning models for computer vision tasks. ImageNet-21K dataset, which is bigger and more diverse, is used less frequ…
An Image is Worth 16x16 Words, What is a Video Worth?
Gilad Sharir, Asaf Noy, Lihi Zelnik-Manor
Leading methods in the domain of action recognition try to distill information from both the spatial and temporal dimensions of an input video. Methods that reach State of the Art…
Asymmetric Loss For Multi-Label Classification
Emanuel Ben-Baruch, Tal Ridnik, Nadav Zamir +4
In a typical multi-label setting, a picture contains on average few positive labels, and many negative ones. This positive-negative imbalance dominates the optimization process, an…
Graph Embedded Pose Clustering for Anomaly Detection
Amir Markovitz, Gilad Sharir, Itamar Friedman +2
We propose a new method for anomaly detection of human actions. Our method works directly on human pose graphs that can be computed from an input video sequence. This makes the ana…
Compact Network Training for Person ReID
Hussam Lawen, Avi Ben-Cohen, Matan Protter +2
The task of person re-identification (ReID) has attracted growing attention in recent years leading to improved performance, albeit with little focus on real-world applications. Mo…
Is Image Memorability Prediction Solved?
Shay Perera, Ayellet Tal, Lihi Zelnik-Manor
This paper deals with the prediction of the memorability of a given image. We start by proposing an algorithm that reaches human-level performance on the LaMem dataset - the only l…
Adversarial Feedback Loop
Firas Shama, Roey Mechrez, Alon Shoshan +1
Thanks to their remarkable generative capabilities, GANs have gained great popularity, and are used abundantly in state-of-the-art methods and applications. In a GAN based model, a…
Dynamic-Net: Tuning the Objective Without Re-training for Synthesis Tasks
Alon Shoshan, Roey Mechrez, Lihi Zelnik-Manor
One of the key ingredients for successful optimization of modern CNNs is identifying a suitable objective. To date, the objective is fixed a-priori at training time, and any variat…
The 2018 PIRM Challenge on Perceptual Image Super-resolution
Yochai Blau, Roey Mechrez, Radu Timofte +2
This paper reports on the 2018 PIRM challenge on perceptual super-resolution (SR), held in conjunction with the Perceptual Image Restoration and Manipulation (PIRM) workshop at ECC…
Maintaining Natural Image Statistics with the Contextual Loss
Roey Mechrez, Itamar Talmi, Firas Shama +1
Maintaining natural image statistics is a crucial factor in restoration and generation of realistic looking images. When training CNNs, photorealism is usually attempted by adversa…
The Contextual Loss for Image Transformation with Non-Aligned Data
Roey Mechrez, Itamar Talmi, Lihi Zelnik-Manor
Feed-forward CNNs trained for image transformation problems rely on loss functions that measure the similarity between the generated image and a target image. Most of the common lo…
Photorealistic Style Transfer with Screened Poisson Equation
Roey Mechrez, Eli Shechtman, Lihi Zelnik-Manor
Recent work has shown impressive success in transferring painterly style to images. These approaches, however, fall short of photorealistic style transfer. Even when both the input…
Template Matching with Deformable Diversity Similarity
Itamar Talmi, Roey Mechrez, Lihi Zelnik-Manor
We propose a novel measure for template matching named Deformable Diversity Similarity -- based on the diversity of feature matches between a target image window and the template.…
Saliency Driven Image Manipulation
Roey Mechrez, Eli Shechtman, Lihi Zelnik-Manor
Have you ever taken a picture only to find out that an unimportant background object ended up being overly salient? Or one of those team sports photos where your favorite player bl…
Approximate Nearest Neighbor Fields in Video
Nir Ben-Zrihem, Lihi Zelnik-Manor
We introduce RIANN (Ring Intersection Approximate Nearest Neighbor search), an algorithm for matching patches of a video to a set of reference patches in real-time. For each query,…