activity
20172024
most citedGrad-SAM: Explaining Transformers via Gradient Self-Attention Maps

43 citations · 97 across the 18 of their papers we have counts for

collaborators

19 papers

cs.CL2024★ 2 cited

InterrogateLLM: Zero-Resource Hallucination Detection in LLM-Generated Answers

Yakir Yehuda, Itzik Malkiel, Oren Barkan +3

Despite the many advances of Large Language Models (LLMs) and their unprecedented rapid evolution, their impact and integration into every facet of our daily lives is limited due t…

cs.CV2023

Efficient Discovery and Effective Evaluation of Visual Perceptual Similarity: A Benchmark and Beyond

Oren Barkan, Tal Reiss, Jonathan Weill +4

Visual similarities discovery (VSD) is an important task with broad e-commerce applications. Given an image of a certain object, the goal of VSD is to retrieve images of different…

cs.LG2023

Representation Learning via Variational Bayesian Networks

Oren Barkan, Avi Caciularu, Idan Rejwan +4

We present Variational Bayesian Network (VBN) - a novel Bayesian entity representation learning model that utilizes hierarchical and relational side information and is particularly…

cs.CL2023★ 2 cited

GPT-Calls: Enhancing Call Segmentation and Tagging by Generating Synthetic Conversations via Large Language Models

Itzik Malkiel, Uri Alon, Yakir Yehuda +4

Transcriptions of phone calls are of significant value across diverse fields, such as sales, customer service, healthcare, and law enforcement. Nevertheless, the analysis of these…

cs.CL2022

Interpreting BERT-based Text Similarity via Activation and Saliency Maps

Itzik Malkiel, Dvir Ginzburg, Oren Barkan +3

Recently, there has been growing interest in the ability of Transformer-based models to produce meaningful embeddings of text with several applications, such as text similarity. De…

cs.CL2022

MetricBERT: Text Representation Learning via Self-Supervised Triplet Training

Itzik Malkiel, Dvir Ginzburg, Oren Barkan +3

We present MetricBERT, a BERT-based model that learns to embed text under a well-defined similarity metric while simultaneously adhering to the ``traditional'' masked-language task…

cs.LG2022★ 43 cited

Grad-SAM: Explaining Transformers via Gradient Self-Attention Maps

Oren Barkan, Edan Hauon, Avi Caciularu +4

Transformer-based language models significantly advanced the state-of-the-art in many linguistic tasks. As this revolution continues, the ability to explain model predictions has b…

eess.IV2021★ 10 cited

Self-Supervised Transformers for fMRI representation

Itzik Malkiel, Gony Rosenman, Lior Wolf +1

We present TFF, which is a Transformer framework for the analysis of functional Magnetic Resonance Imaging (fMRI) data. TFF employs a two-phase training approach. First, self-super…

cs.CV2021

Caption Enriched Samples for Improving Hateful Memes Detection

Efrat Blaier, Itzik Malkiel, Lior Wolf

The recently introduced hateful meme challenge demonstrates the difficulty of determining whether a meme is hateful or not. Specifically, both unimodal language models and multimod…

cs.CV2021★ 1 cited

GAM: Explainable Visual Similarity and Classification via Gradient Activation Maps

Oren Barkan, Omri Armstrong, Amir Hertz +4

We present Gradient Activation Maps (GAM) - a machinery for explaining predictions made by visual similarity and classification models. By gleaning localized gradient and activatio…

cs.CL2021★ 16 cited

Self-Supervised Document Similarity Ranking via Contextualized Language Models and Hierarchical Inference

Dvir Ginzburg, Itzik Malkiel, Oren Barkan +2

We present a novel model for the problem of ranking a collection of documents according to their semantic similarity to a source (query) document. While the problem of document-to-…

eess.IV2021

Adaptive Gradient Balancing for Undersampled MRI Reconstruction and Image-to-Image Translation

Itzik Malkiel, Sangtae Ahn, Valentina Taviani +3

Recent accelerated MRI reconstruction models have used Deep Neural Networks (DNNs) to reconstruct relatively high-quality images from highly undersampled k-space data, enabling muc…

cs.IR2020

RecoBERT: A Catalog Language Model for Text-Based Recommendations

Itzik Malkiel, Oren Barkan, Avi Caciularu +3

Language models that utilize extensive self-supervised pre-training from unlabeled text, have recently shown to significantly advance the state-of-the-art performance in a variety…

cs.LG2020

MTAdam: Automatic Balancing of Multiple Training Loss Terms

Itzik Malkiel, Lior Wolf

When training neural models, it is common to combine multiple loss terms. The balancing of these terms requires considerable human effort and is computationally demanding. Moreover…

eess.IV2019

Spectra2pix: Generating Nanostructure Images from Spectra

Itzik Malkiel, Michael Mrejen, Lior Wolf +1

The design of the nanostructures that are used in the field of nano-photonics has remained complex, very often relying on the intuition and expertise of the designer, ultimately li…

cs.CL2019

MML: Maximal Multiverse Learning for Robust Fine-Tuning of Language Models

Itzik Malkiel, Lior Wolf

Recent state-of-the-art language models utilize a two-phase training procedure comprised of (i) unsupervised pre-training on unlabeled text, and (ii) fine-tuning for a specific sup…

cs.LG2019

Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding

Oren Barkan, Noam Razin, Itzik Malkiel +3

Recent state-of-the-art natural language understanding models, such as BERT and XLNet, score a pair of sentences (A and B) using multiple cross-attention operations - a process in…

cs.LG2019★ 5 cited

Conditional WGANs with Adaptive Gradient Balancing for Sparse MRI Reconstruction

Itzik Malkiel, Sangtae Ahn, Valentina Taviani +3

Recent sparse MRI reconstruction models have used Deep Neural Networks (DNNs) to reconstruct relatively high-quality images from highly undersampled k-space data, enabling much fas…

physics.optics2017★ 18 cited

Deep Learning for Design and Retrieval of Nano-photonic Structures

Itzik Malkiel, Achiya Nagler, Michael Mrejen +3

Our visual perception of our surroundings is ultimately limited by the diffraction limit, which stipulates that optical information smaller than roughly half the illumination wavel…