5 citations · 6 across the 6 of their papers we have counts for
6 papers
Seeing Voices: Generating A-Roll Video from Audio with Mirage
Aditi Sundararaman, Amogh Adishesha, Andrew Jaegle +10
From professional filmmaking to user-generated content, creators and consumers have long recognized that the power of video depends on the harmonious integration of what we hear (t…
LatentColorization: Latent Diffusion-Based Speaker Video Colorization
Rory Ward, Dan Bigioi, Shubhajit Basak +2
While current research predominantly focuses on image-based colorization, the domain of video-based colorization remains relatively unexplored. Most existing video colorization tec…
Synthetic Speaking Children -- Why We Need Them and How to Make Them
Muhammad Ali Farooq, Dan Bigioi, Rishabh Jain +3
Contemporary Human Computer Interaction (HCI) research relies primarily on neural network models for machine vision and speech understanding of a system user. Such models require e…
Speech Driven Video Editing via an Audio-Conditioned Diffusion Model
Dan Bigioi, Shubhajit Basak, Michał Stypułkowski +4
Taking inspiration from recent developments in visual generative tasks using diffusion models, we propose a method for end-to-end speech-driven video editing using a denoising diff…
A Text-to-Speech Pipeline, Evaluation Methodology, and Initial Fine-Tuning Results for Child Speech Synthesis
Rishabh Jain, Mariam Yiwere, Dan Bigioi +2
Speech synthesis has come a long way as current text-to-speech (TTS) models can now generate natural human-sounding speech. However, most of the TTS research focuses on using adult…
A Wav2vec2-Based Experimental Study on Self-Supervised Learning Methods to Improve Child Speech Recognition
Rishabh Jain, Andrei Barcovschi, Mariam Yiwere +3
Despite recent advancements in deep learning technologies, Child Speech Recognition remains a challenging task. Current Automatic Speech Recognition (ASR) models require substantia…