80 citations
- Institut de Recherche et Coordination Acoustique MusiqueFR33 papers
- Centre National de la Recherche ScientifiqueFR19 papers
- Sorbonne UniversitéFR15 papers
- Institut Systèmes Intelligents et de RobotiqueFR6 papers
- Centre de Recherche en Sciences et Technologies de l'Information et de la CommunicationFR3 papers
- Institut national de recherche en sciences et technologies du numériqueFR2 papers
- KTH Royal Institute of TechnologySE2 papers
- Sony Computer Science LaboratoriesJP2 papers
- Université de Reims Champagne-ArdenneFR2 papers
- ACT Government1 paper
- Ben-Gurion University of the NegevIL1 paper
- Bibliothèque Nationale de FranceFR1 paper
14 papers · 1 filter
Gelina: Unified Speech and Gesture Synthesis via Interleaved Token Prediction
Téo Guichoux, Théodor Lemerle, Shivam Mehta +5
Human communication is multimodal, with speech and gestures tightly coupled, yet most computational methods for generating speech and gestures synthesize them sequentially, weakeni…
Tipping Points, Pulse Elasticity and Tonal Tension: An Empirical Study on What Generates Tipping Points
Canishk Naik, Elaine Chew
Tipping points are moments of change that characterise crucial turning points in a piece of music. This study presents a first step towards quantitatively and systematically descri…
Combining audio control and style transfer using latent diffusion
Nils Demerlé, Philippe Esling, Guillaume Doras +1
Deep generative models are now able to synthesize high-quality audio signals, shifting the critical aspect in their development from audio quality to control capabilities. Although…
SingSong: Generating musical accompaniments from singing
Chris Donahue, Antoine Caillon, Adam Roberts +8
We present SingSong, a system that generates instrumental music to accompany input vocals, potentially offering musicians and non-musicians alike an intuitive new way to create mus…
A Model You Can Hear: Audio Identification with Playable Prototypes
Romain Loiseau, Baptiste Bouvier, Yann Teytaut +3
Machine learning techniques have proved useful for classifying and analyzing audio content. However, recent methods typically rely on abstract and high-dimensional representations…
Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding
Mireille Fares, Michele Grimaldi, Catherine Pelachaud +1
Modeling virtual agents with behavior style is one factor for personalizing human agent interaction. We propose an efficient yet effective machine learning approach to synthesize g…