28 citations · 38 across the 13 of their papers we have counts for
15 papers
Shared Latent Representation for Joint Text-to-Audio-Visual Synthesis
Dogucan Yaman, Seymanur Akti, Fevziye Irem Eyiokur +1
We propose a text-to-talking-face synthesis framework leveraging latent speech representations from HierSpeech++. A Text-to-Vec module generates Wav2Vec2 embeddings from text, whic…
Assessing Identity Leakage in Talking Face Generation: Metrics and Evaluation Framework
Dogucan Yaman, Fevziye Irem Eyiokur, Hazım Kemal Ekenel +1
Video editing-based talking face generation aims to preserve video details such as pose, lighting, and gestures while modifying only lip motion, often using an identity reference i…
A Multimodal Depth-Aware Method For Embodied Reference Understanding
Fevziye Irem Eyiokur, Dogucan Yaman, Hazım Kemal Ekenel +1
Embodied Reference Understanding requires identifying a target object in a visual scene based on both language instructions and pointing cues. While prior works have shown progress…
CAPE: A CLIP-Aware Pointing Ensemble of Complementary Heatmap Cues for Embodied Reference Understanding
Fevziye Irem Eyiokur, Dogucan Yaman, Hazım Kemal Ekenel +1
We address Embodied Reference Understanding, the task of predicting the object a person in the scene refers to through pointing gesture and language. This requires multimodal reaso…
Audio-driven Talking Face Generation with Stabilized Synchronization Loss
Dogucan Yaman, Fevziye Irem Eyiokur, Leonard Bärmann +2
Talking face generation aims to create realistic videos with accurate lip synchronization and high visual quality, using given audio and reference video while preserving identity a…
Train Global, Tailor Local: Minimalist Multilingual Translation into Endangered Languages
Zhong Zhou, Jan Niehues, Alex Waibel
In many humanitarian scenarios, translation into severely low resource languages often does not require a universal translation engine, but a dedicated text-specific translation en…
A Survey on Computer Vision based Human Analysis in the COVID-19 Era
Fevziye Irem Eyiokur, Alperen Kantarcı, Mustafa Ekrem Erakın +8
The emergence of COVID-19 has had a global and profound impact, not only on society as a whole, but also on the lives of individuals. Various prevention measures were introduced ar…
Face-Dubbing++: Lip-Synchronous, Voice Preserving Translation of Videos
Alexander Waibel, Moritz Behr, Fevziye Irem Eyiokur +7
In this paper, we propose a neural end-to-end system for voice preserving, lip-synchronous translation of videos. The system is designed to combine multiple component models and pr…
Exposure Correction Model to Enhance Image Quality
Fevziye Irem Eyiokur, Dogucan Yaman, Hazım Kemal Ekenel +1
Exposure errors in an image cause a degradation in the contrast and low visibility in the content. In this paper, we address this problem and propose an end-to-end exposure correct…
Alpha Matte Generation from Single Input for Portrait Matting
Dogucan Yaman, Hazım Kemal Ekenel, Alexander Waibel
In the portrait matting, the goal is to predict an alpha matte that identifies the effect of each pixel on the foreground subject. Traditional approaches and most of the existing w…
CAGAN: Text-To-Image Generation with Combined Attention GANs
Henning Schulze, Dogucan Yaman, Alexander Waibel
Generating images according to natural language descriptions is a challenging task. Prior research has mainly focused to enhance the quality of generation by investigating the use…
Family of Origin and Family of Choice: Massively Parallel Lexiconized Iterative Pretraining for Severely Low Resource Machine Translation
Zhong Zhou, Alex Waibel
We translate a closed text that is known in advance into a severely low resource language by leveraging massive source parallelism. In other words, given a text in 124 source langu…
Unconstrained Face-Mask & Face-Hand Datasets: Building a Computer Vision System to Help Prevent the Transmission of COVID-19
Fevziye Irem Eyiokur, Hazım Kemal Ekenel, Alexander Waibel
Health organizations advise social distancing, wearing face mask, and avoiding touching face to prevent the spread of coronavirus. Based on these protective measures, we developed…
Error correction and extraction in request dialogs
Stefan Constantin, Alex Waibel
We propose a dialog system utility component that gets the last two utterances of a user and can detect whether the last utterance is an error correction of the second last utteran…
Gun Source and Muzzle Head Detection
Zhong Zhou, Isak Czeresnia Etinger, Florian Metze +2
There is a surging need across the world for protection against gun violence. There are three main areas that we have identified as challenging in research that tries to curb gun v…