21 citations · 26 across the 8 of their papers we have counts for
8 papers
Woosh: A Sound Effects Foundation Model
Gaëtan Hadjeres, Marc Ferras, Khaled Koutini +7
The audio research community depends on open generative models as foundational tools for building novel approaches and establishing baselines. In this report, we present Woosh, Son…
EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrieval
Thomas Hummel, Shyamgopal Karthik, Mariana-Iuliana Georgescu +1
In Composed Video Retrieval, a video and a textual description which modifies the video content are provided as inputs to the model. The aim is to retrieve the relevant video with…
Video-adverb retrieval with compositional adverb-action embeddings
Thomas Hummel, Otniel-Bogdan Mercea, A. Sophia Koepke +1
Retrieving adverbs that describe an action in a video poses a crucial step towards fine-grained video understanding. We propose a framework for video-to-adverb retrieval (and vice…
Text-to-feature diffusion for audio-visual few-shot learning
Otniel-Bogdan Mercea, Thomas Hummel, A. Sophia Koepke +1
Training deep learning models for video classification from audio-visual data commonly requires immense amounts of labeled training data collected via a costly process. A challengi…
Semantic Image Synthesis with Semantically Coupled VQ-Model
Stephan Alaniz, Thomas Hummel, Zeynep Akata
Semantic image synthesis enables control over unconditional image generation by allowing guidance on what is being generated. We conditionally synthesize the latent space from a ve…
Temporal and cross-modal attention for audio-visual zero-shot learning
Otniel-Bogdan Mercea, Thomas Hummel, A. Sophia Koepke +1
Audio-visual generalised zero-shot learning for video classification requires understanding the relations between the audio and visual information in order to be able to recognise…
Where and When: Space-Time Attention for Audio-Visual Explanations
Yanbei Chen, Thomas Hummel, A. Sophia Koepke +1
Explaining the decision of a multi-modal decision-maker requires to determine the evidence from both modalities. Recent advances in XAI provide explanations for models trained on s…
Crossmodal Language Grounding in an Embodied Neurocognitive Model
Stefan Heinrich, Yuan Yao, Tobias Hinz +5
Human infants are able to acquire natural language seemingly easily at an early age. Their language learning seems to occur simultaneously with learning other cognitive functions a…