45 citations · 135 across the 16 of their papers we have counts for
6 papers · 1 filter
Latent Space Explanation by Intervention
Itai Gat, Guy Lorberbom, Idan Schwartz +1
The success of deep neural nets heavily relies on their ability to encode complex relations between their input and their output. While this property serves to fit the training dat…
ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
Yoad Tewel, Yoav Shalev, Idan Schwartz +1
Recent text-to-image matching models apply contrastive learning to large corpora of uncurated pairs of images and sentences. While such models can provide a powerful score for matc…
Perceptual Score: What Data Modalities Does Your Model Perceive?
Itai Gat, Idan Schwartz, Alexander Schwing
Machine learning advances in the last decade have relied significantly on large-scale datasets that continue to grow in size. Increasingly, those datasets also contain different da…
Video and Text Matching with Conditioned Embeddings
Ameen Ali, Idan Schwartz, Tamir Hazan +1
We present a method for matching a text sentence from a given corpus to a given video clip and vice versa. Traditionally video and text matching is done by learning a shared embedd…
Ordered Attention for Coherent Visual Storytelling
Tom Braude, Idan Schwartz, Alexander Schwing +1
We address the problem of visual storytelling, i.e., generating a story for a given sequence of images. While each sentence of the story should describe a corresponding image, a co…
Ensemble of MRR and NDCG models for Visual Dialog
Idan Schwartz
Assessing an AI agent that can converse in human language and understand visual content is challenging. Generation metrics, such as BLEU scores favor correct syntax over semantics.…