154 citations · 510 across the 52 of their papers we have counts for
10 papers · 1 filter
LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Reading
Leyuan Qu, Cornelius Weber, Stefan Wermter
The aim of this work is to investigate the impact of crossmodal self-supervised pre-training for speech reconstruction (video-to-audio) by leveraging the natural co-occurrence of a…
Lifelong Learning from Event-based Data
Vadym Gryshchuk, Cornelius Weber, Chu Kiong Loo +1
Lifelong learning is a long-standing aim for artificial agents that act in dynamic environments, in which an agent needs to accumulate knowledge incrementally without forgetting pr…
FaVoA: Face-Voice Association Favours Ambiguous Speaker Detection
Hugo Carneiro, Cornelius Weber, Stefan Wermter
The strong relation between face and voice can aid active speaker detection systems when faces are visible, even in difficult settings, when the face of a speaker is not clear or w…
Generalization in Multimodal Language Learning from Simulation
Aaron Eisermann, Jae Hee Lee, Cornelius Weber +1
Neural networks can be powerful function approximators, which are able to model high-dimensional feature distributions from a subset of examples drawn from the target distribution.…
Robotic Occlusion Reasoning for Efficient Object Existence Prediction
Mengdi Li, Cornelius Weber, Matthias Kerzel +4
Reasoning about potential occlusions is essential for robots to efficiently predict whether an object exists in an environment. Though existing work shows that a robot with active…
Survey on reinforcement learning for language processing
Victor Uc-Cetina, Nicolas Navarro-Guerrero, Anabel Martin-Gonzalez +2
In recent years some researchers have explored the use of reinforcement learning (RL) algorithms as key components in the solution of various natural language processing tasks. For…