80 citations
Counting papers with at most 25 authors, so collaboration author lists do not stand in for the people here.
- Sciences et Technologies de la Musique et du SonFR33 papers
- Centre National de la Recherche ScientifiqueFR19 papers
- Sorbonne UniversitéFR14 papers
- Institut Systèmes Intelligents et de RobotiqueFR6 papers
- KTH Royal Institute of TechnologySE2 papers
- Liceo scientifico statale Ulisse Dini2 papers
- Sony Computer Science LaboratoriesJP2 papers
- University of FlorenceIT2 papers
- University of PaduaIT2 papers
- ACT Government1 paper
- Ben-Gurion University of the NegevIL1 paper
- Campo Arqueologico de MertolaPT1 paper
51 papers
AMACA: Astronomy education with a Multi-sensory, Accessible, and Circular Approach
Rachele Toniolo, Anita Zanella, Andrea Cottinelli +4
The AMACA project (Astronomy education with a Multi-sensory, Accessible, and Circular Approach) develops multi-sensory activities for accessible education and engagement in astrono…
Gelina: Unified Speech and Gesture Synthesis via Interleaved Token Prediction
Téo Guichoux, Théodor Lemerle, Shivam Mehta +5
Human communication is multimodal, with speech and gestures tightly coupled, yet most computational methods for generating speech and gestures synthesize them sequentially, weakeni…
Learning Relationships Between Separate Audio Tracks for Creative Applications
Balthazar Bujard, Jérôme Nika, Fédéric Bevilacqua +1
This paper presents the first step in a research project situated within the field of musical agents. The objective is to achieve, through training, the tuning of the desired music…
Tipping Points, Pulse Elasticity and Tonal Tension: An Empirical Study on What Generates Tipping Points
Canishk Naik, Elaine Chew
Tipping points are moments of change that characterise crucial turning points in a piece of music. This study presents a first step towards quantitatively and systematically descri…
DJ Mix Transcription with Multi-Pass Non-Negative Matrix Factorization
Étienne Paul André, Dominique Fourer, Diemo Schwarz
DJ mix transcription is a crucial step towards DJ mix reverse engineering, which estimates the set of parameters and audio effects applied to a set of existing tracks to produce a…
Unsupervised Composable Representations for Audio
Giovanni Bindi, Philippe Esling
Current generative models are able to generate high-quality artefacts but have been shown to struggle with compositional reasoning, which can be defined as the ability to generate…
Combining audio control and style transfer using latent diffusion
Nils Demerlé, Philippe Esling, Guillaume Doras +1
Deep generative models are now able to synthesize high-quality audio signals, shifting the critical aspect in their development from audio quality to control capabilities. Although…
Investigating the impact of 2D gesture representation on co-speech gesture generation
Teo Guichoux, Laure Soulier, Nicolas Obin +1
Co-speech gestures play a crucial role in the interactions between humans and embodied conversational agents (ECA). Recent deep learning methods enable the generation of realistic,…
Taking Music Seriously: on the Dynamics of 'Mathemusical' Research with a Focus on Hexachordal Theorems
Moreno Andreatta, Corentin Guichaoua, Nicolas Juillet
After presenting the general framework of 'mathemusical' dynamics, we focus on one music-theoretical problem concerning a special case of homometry theory applied to music composit…
Design framework for spherical microphone and loudspeaker arrays in a multiple-input multiple-output system
Hai Morgenstern, Boaz Rafaely, Markus Noisternig
Spherical microphone arrays (SMAs) and spherical loudspeaker arrays (SLAs) facilitate the study of room acoustics due to the three-dimensional analysis they provide. More recently,…
META4: Semantically-Aligned Generation of Metaphoric Gestures Using Self-Supervised Text and Speech Representation
Mireille Fares, Catherine Pelachaud, Nicolas Obin
Image Schemas are repetitive cognitive patterns that influence the way we conceptualize and reason about various concepts present in speech. These patterns are deeply embedded with…
TranSTYLer: Multimodal Behavioral Style Transfer for Facial and Body Gestures Generation
Mireille Fares, Catherine Pelachaud, Nicolas Obin
This paper addresses the challenge of transferring the behavior expressivity style of a virtual agent to another one while preserving behaviors shape as they carry communicative me…
AMII: Adaptive Multimodal Inter-personal and Intra-personal Model for Adapted Behavior Synthesis
Jieyeon Woo, Mireille Fares, Catherine Pelachaud +1
Socially Interactive Agents (SIAs) are physical or virtual embodied agents that display similar behavior as human multimodal behavior. Modeling SIAs' non-verbal behavior, such as s…
SingSong: Generating musical accompaniments from singing
Chris Donahue, Antoine Caillon, Adam Roberts +8
We present SingSong, a system that generates instrumental music to accompany input vocals, potentially offering musicians and non-musicians alike an intuitive new way to create mus…
Sound people speak to Star people. A sound experts perspective on astronomy sonification projects
Nicolas Misdariis, Elif Özcan, Massimo Grassi +4
The Audible Universe project aims at making dialogue between two scientific domains investigating two distinct research objects, briefly said, Stars and Sound. It has been instanti…
Entangling Practice with Artistic and Educational Aims: Interviews on Technology-based Movement Sound Interactions
Victor Paredes, Jules Françoise, Frédéric Bevilacqua
Movement-sound interactive systems are at the interface of different artistic and educational practices. Within this multiplicity of uses, we examine common denominators in terms o…
A Model You Can Hear: Audio Identification with Playable Prototypes
Romain Loiseau, Baptiste Bouvier, Yann Teytaut +3
Machine learning techniques have proved useful for classifying and analyzing audio content. However, recent methods typically rely on abstract and high-dimensional representations…
Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding
Mireille Fares, Michele Grimaldi, Catherine Pelachaud +1
Modeling virtual agents with behavior style is one factor for personalizing human agent interaction. We propose an efficient yet effective machine learning approach to synthesize g…
Audible universe
Chris Harrison, Anita Zanella, Nic Bonne +2
A multi-disciplinary team recently came together online to discuss the application of sonification in astronomy, focussing on the effective use of sound for scientific discovery an…
Streamable Neural Audio Synthesis With Non-Causal Convolutions
Antoine Caillon, Philippe Esling
Deep learning models are mostly used in an offline inference fashion. However, this strongly limits the use of these models inside audio generation setups, as most creative workflo…
Analysis and transformations of voice level in singing voice
Frederik Bous, Axel Roebel
We introduce a neural auto-encoder that transforms the musical dynamic in recordings of singing voice via changes in voice level. Since most recordings of singing voice are not ann…
RAVE: A variational autoencoder for fast and high-quality neural audio synthesis
Antoine Caillon, Philippe Esling
Deep generative models applied to audio have improved by a large margin the state-of-the-art in many speech and music related tasks. However, as raw waveform modelling remains an i…
An Exploratory Study on Perceptual Spaces of the Singing Voice
Brendan O'Connor, Simon Dixon, George Fazekas
Sixty participants provided dissimilarity ratings between various singing techniques. Multidimensional scaling, class averaging and clustering techniques were used to analyse timbr…
Signal-domain representation of symbolic music for learning embedding spaces
Mathieu Prang, Philippe Esling
A key aspect of machine learning models lies in their ability to learn efficient intermediate features. However, the input representation plays a crucial role in this process, and…