80 citations
- Institut de Recherche et Coordination Acoustique MusiqueFR29 papers
- Centre National de la Recherche ScientifiqueFR16 papers
- Sorbonne UniversitéFR13 papers
- Institut Systèmes Intelligents et de RobotiqueFR6 papers
- Institut national de recherche en sciences et technologies du numériqueFR2 papers
- KTH Royal Institute of TechnologySE2 papers
- Sony Computer Science LaboratoriesJP2 papers
- ACT Government1 paper
- Ben-Gurion University of the NegevIL1 paper
- Campo Arqueologico de MertolaPT1 paper
- Centre de Recherche en InformatiqueFR1 paper
- Delft University of TechnologyNL1 paper
33 papers
Gelina: Unified Speech and Gesture Synthesis via Interleaved Token Prediction
Téo Guichoux, Théodor Lemerle, Shivam Mehta +5
Human communication is multimodal, with speech and gestures tightly coupled, yet most computational methods for generating speech and gestures synthesize them sequentially, weakeni…
Tipping Points, Pulse Elasticity and Tonal Tension: An Empirical Study on What Generates Tipping Points
Canishk Naik, Elaine Chew
Tipping points are moments of change that characterise crucial turning points in a piece of music. This study presents a first step towards quantitatively and systematically descri…
Unsupervised Composable Representations for Audio
Giovanni Bindi, Philippe Esling
Current generative models are able to generate high-quality artefacts but have been shown to struggle with compositional reasoning, which can be defined as the ability to generate…
Combining audio control and style transfer using latent diffusion
Nils Demerlé, Philippe Esling, Guillaume Doras +1
Deep generative models are now able to synthesize high-quality audio signals, shifting the critical aspect in their development from audio quality to control capabilities. Although…
Investigating the impact of 2D gesture representation on co-speech gesture generation
Teo Guichoux, Laure Soulier, Nicolas Obin +1
Co-speech gestures play a crucial role in the interactions between humans and embodied conversational agents (ECA). Recent deep learning methods enable the generation of realistic,…
Taking Music Seriously: on the Dynamics of 'Mathemusical' Research with a Focus on Hexachordal Theorems
Moreno Andreatta, Corentin Guichaoua, Nicolas Juillet
After presenting the general framework of 'mathemusical' dynamics, we focus on one music-theoretical problem concerning a special case of homometry theory applied to music composit…