93 citations · 259 across the 35 of their papers we have counts for
22 papers · 1 filter
End to End Lip Synchronization with a Temporal AutoEncoder
Yoav Shalev, Lior Wolf
We study the problem of syncing the lip movement in a video with the audio stream. Our solution finds an optimal alignment using a dual-domain recurrent neural network that is trai…
Dynamic Dual-Output Diffusion Models
Yaniv Benny, Lior Wolf
Iterative denoising-based generation, also known as denoising diffusion models, has recently been shown to be comparable in quality to other classes of generative models, and even…
Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers
Hila Chefer, Shir Gur, Lior Wolf
Transformers are increasingly dominating multi-modal reasoning tasks, such as visual question answering, achieving state-of-the-art results thanks to their ability to contextualize…
Visualization of Supervised and Self-Supervised Neural Networks via Attribution Guided Factorization
Shir Gur, Ameen Ali, Lior Wolf
Neural network visualization techniques mark image locations by their relevancy to the network's classification. Existing methods are effective in highlighting the regions that aff…
HyperSeg: Patch-wise Hypernetwork for Real-time Semantic Segmentation
Yuval Nirkin, Lior Wolf, Tal Hassner
We present a novel, real-time, semantic segmentation network in which the encoder both encodes and generates the parameters (weights) of the decoder. Furthermore, to allow maximal…
Transformer Interpretability Beyond Attention Visualization
Hila Chefer, Shir Gur, Lior Wolf
Self-attention techniques, and specifically Transformers, are dominating the field of text processing and are becoming increasingly popular in computer vision classification tasks.…