16 citations · 60 across the 78 of their papers we have counts for
11 papers · 1 filter
StyleStream 2.0: Fast and Controllable Streaming Voice Style Conversion
Yisi Liu, Nicholas Lee, Gopala K. Anumanchipalli
Voice style conversion (VSC) aims to transform a source utterance to match the timbre, accent, and emotion of a target voice while preserving linguistic content. StyleStream 1.0 in…
StyleStream: Real-Time Zero-Shot Voice Style Conversion
Yisi Liu, Nicholas Lee, Gopala Anumanchipalli
Voice style conversion aims to transform an input utterance to match a target speaker's timbre, accent, and emotion, with a central challenge being the disentanglement of linguisti…
TART: A Comprehensive Tool for Technique-Aware Audio-to-Tab Guitar Transcription
Akshaj Gupta, Andrea Guzman, Anagha Badriprasad +5
Automatic Music Transcription (AMT) has advanced significantly for the piano, but transcription for the guitar remains limited due to several key challenges. Existing systems fail…
Audio Texture Manipulation by Exemplar-Based Analogy
Kan Jen Cheng, Tingle Li, Gopala Anumanchipalli
Audio texture manipulation involves modifying the perceptual characteristics of a sound to achieve specific transformations, such as adding, removing, or replacing auditory element…
Speech After Gender: A Trans-Feminine Perspective on Next Steps for Speech Science and Technology
Robin Netzorg, Alyssa Cote, Sumi Koshin +2
As experts in voice modification, trans-feminine gender-affirming voice teachers have unique perspectives on voice that confound current understandings of speaker identity. To demo…
PerMod: Perceptually Grounded Voice Modification with Latent Diffusion Models
Robin Netzorg, Ajil Jalal, Luna McNulty +1
Perceptual modification of voice is an elusive goal. While non-experts can modify an image or sentence perceptually with available tools, it is not clear how to similarly modify sp…
Towards Streaming Speech-to-Avatar Synthesis
Tejas S. Prabhune, Peter Wu, Bohan Yu +1
Streaming speech-to-avatar synthesis creates real-time animations for a virtual character from audio data. Accurate avatar representations of speech are important for the visualiza…
Towards an Interpretable Representation of Speaker Identity via Perceptual Voice Qualities
Robin Netzorg, Bohan Yu, Andrea Guzman +3
Unlike other data modalities such as text and vision, speech does not lend itself to easy interpretation. While lay people can understand how to describe an image or sentence via p…
CiwaGAN: Articulatory information exchange
Gašper Beguš, Thomas Lu, Alan Zhou +2
Humans encode information into sounds by controlling articulators and decode information from sounds using the auditory apparatus. This paper introduces CiwaGAN, a model of human s…
Enhancing GAN-Based Vocoders with Contrastive Learning Under Data-limited Condition
Haoming Guo, Seth Z. Zhao, Jiachen Lian +2
Vocoder models have recently achieved substantial progress in generating authentic audio comparable to human quality while significantly reducing memory requirement and inference t…
Articulation GAN: Unsupervised modeling of articulatory learning
Gašper Beguš, Alan Zhou, Peter Wu +1
Generative deep neural networks are widely used for speech synthesis, but most existing models directly generate waveforms or spectral outputs. Humans, however, produce speech by c…