52 citations · 108 across the 12 of their papers we have counts for
16 papers
AVControl: Efficient Framework for Training Audio-Visual Controls
Matan Ben-Yosef, Tavi Halperin, Naomi Ken Korem +6
Controlling video and audio generation requires diverse modalities, from depth and pose to camera trajectories and audio transformations, yet existing approaches either train a sin…
JUST-DUB-IT: Video Dubbing via Joint Audio-Visual Diffusion
Anthony Chen, Naomi Ken Korem, Gal Zeevi +6
Audio-Visual Foundation Models, which are pretrained to jointly generate sound and visual content, have recently shown an unprecedented ability to model multi-modal generation and…
CAFA: a Controllable Automatic Foley Artist
Roi Benita, Michael Finkelson, Tavi Halperin +2
Foley is a key element in video production, refers to the process of adding an audio signal to a silent video while ensuring semantic and temporal alignment. In recent years, the r…
V-LASIK: Consistent Glasses-Removal from Videos Using Synthetic Data
Rotem Shalev-Arkushin, Aharon Azulay, Tavi Halperin +3
Diffusion-based generative models have recently shown remarkable image and video editing capabilities. However, local video editing, particularly removal of small attributes like g…
Diffusing Colors: Image Colorization with Text Guided Diffusion
Nir Zabari, Aharon Azulay, Alexey Gorkor +2
The colorization of grayscale images is a complex and subjective task with significant challenges. Despite recent progress in employing large-scale datasets with deep neural networ…
Temporally stable video segmentation without video annotations
Aharon Azulay, Tavi Halperin, Orestis Vantzos +2
Temporally consistent dense video annotations are scarce and hard to collect. In contrast, image segmentation datasets (and pre-trained models) are ubiquitous, and easier to label…
Endless Loops: Detecting and Animating Periodic Patterns in Still Images
Tavi Halperin, Hanit Hakim, Orestis Vantzos +6
We present an algorithm for producing a seamless animated loop from a single image. The algorithm detects periodic structures, such as the windows of a building or the steps of a s…
Clear Skies Ahead: Towards Real-Time Automatic Sky Replacement in Video
Tavi Halperin, Harel Cain, Ofir Bibi +1
Digital videos such as those captured by a smartphone often exhibit exposure inconsistencies, a poorly exposed sky, or simply suffer from an uninteresting or plain looking sky. Pro…
Neural separation of observed and unobserved distributions
Tavi Halperin, Ariel Ephrat, Yedid Hoshen
Separating mixed distributions is a long standing challenge for machine learning and signal processing. Most current methods either rely on making strong assumptions on the source…
Dynamic Temporal Alignment of Speech to Lips
Tavi Halperin, Ariel Ephrat, Shmuel Peleg
Many speech segments in movies are re-recorded in a studio during postproduction, to compensate for poor sound quality as recorded on location. Manual alignment of the newly-record…
Improved Speech Reconstruction from Silent Video
Ariel Ephrat, Tavi Halperin, Shmuel Peleg
Speechreading is the task of inferring phonetic information from visually observed articulatory facial movements, and is a notoriously difficult task for humans to perform. In this…
Seeing Through Noise: Visually Driven Speaker Separation and Enhancement
Aviv Gabbay, Ariel Ephrat, Tavi Halperin +1
Isolating the voice of a specific person while filtering out other voices or background noises is challenging when video is shot in noisy environments. We propose audio-visual meth…
An Epipolar Line from a Single Pixel
Tavi Halperin, Michael Werman
Computing the epipolar geometry from feature points between cameras with very different viewpoints is often error prone, as an object's appearance can vary greatly between images.…
EgoSampling: Wide View Hyperlapse from Egocentric Videos
Tavi Halperin, Yair Poleg, Chetan Arora +1
The possibility of sharing one's point of view makes use of wearable cameras compelling. These videos are often long, boring and coupled with extreme shake, as the camera is worn o…
Epipolar Geometry Based On Line Similarity
Gil Ben-Artzi, Tavi Halperin, Michael Werman +1
It is known that epipolar geometry can be computed from three epipolar line correspondences but this computation is rarely used in practice since there are no simple methods to fin…
EgoSampling: Fast-Forward and Stereo for Egocentric Videos
Yair Poleg, Tavi Halperin, Chetan Arora +1
While egocentric cameras like GoPro are gaining popularity, the videos they capture are long, boring, and difficult to watch from start to end. Fast forwarding (i.e. frame sampling…