activity
20202022
most citedImproving Neural Silent Speech Interface Models by Adversarial Training

12 citations · 16 across the 8 of their papers we have counts for

collaborators

15 papers

cs.SD2022

Towards Parametric Speech Synthesis Using Gaussian-Markov Model of Spectral Envelope and Wavelet-Based Decomposition of F0

Mohammed Salah Al-Radhi, Tamás Gábor Csapó, Csaba Zainkó +1

Neural network-based Text-to-Speech has significantly improved the quality of synthesized speech. Prominent methods (e.g., Tacotron2, FastSpeech, FastPitch) usually generate Mel-sp…

cs.SD2021

Speaker Adaptation with Continuous Vocoder-based DNN-TTS

Ali Raheem Mandeel, Mohammed Salah Al-Radhi, Tamás Gábor Csapó

Traditional vocoder-based statistical parametric speech synthesis can be advantageous in applications that require low computational complexity. Recent neural vocoders, which can p…

eess.AS2021

Adaptation of Tacotron2-based Text-To-Speech for Articulatory-to-Acoustic Mapping using Ultrasound Tongue Imaging

Csaba Zainkó, László Tóth, Amin Honarmandi Shandiz +4

For articulatory-to-acoustic mapping, typically only limited parallel training data is available, making it impossible to apply fully end-to-end solutions like Tacotron2. In this p…

eess.AS2021

Extending Text-to-Speech Synthesis with Articulatory Movement Prediction using Ultrasound Tongue Imaging

Tamás Gábor Csapó

In this paper, we present our first experiments in text-to-articulation prediction, using ultrasound tongue image targets. We extend a traditional (vocoder-based) DNN-TTS framework…

eess.AS2021

Speech Synthesis from Text and Ultrasound Tongue Image-based Articulatory Input

Tamás Gábor Csapó, László Tóth, Gábor Gosztolya +1

Articulatory information has been shown to be effective in improving the performance of HMM-based and DNN-based text-to-speech synthesis. Speech synthesis research focuses traditio…

cs.SD2021

Advances in Speech Vocoding for Text-to-Speech with Continuous Parameters

Mohammed Salah Al-Radhi, Tamás Gábor Csapó, Géza Németh

Vocoders received renewed attention as main components in statistical parametric text-to-speech (TTS) synthesis and speech transformation systems. Even though there are vocoding te…

cs.SD2021

Continuous Wavelet Vocoder-based Decomposition of Parametric Speech Waveform Synthesis

Mohammed Salah Al-Radhi, Tamás Gábor Csapó, Csaba Zainkó +1

To date, various speech technology systems have adopted the vocoder approach, a method for synthesizing speech waveform that shows a major role in the performance of statistical pa…

cs.SD2021

Neural Speaker Embeddings for Ultrasound-based Silent Speech Interfaces

Amin Honarmandi Shandiz, László Tóth, Gábor Gosztolya +2

Articulatory-to-acoustic mapping seeks to reconstruct speech from a recording of the articulatory movements, for example, an ultrasound video. Just like speech signals, these recor…

cs.CV2021

Towards a practical lip-to-speech conversion system using deep neural networks and mobile application frontend

Frigyes Viktor Arthur, Tamás Gábor Csapó

Articulatory-to-acoustic (forward) mapping is a technique to predict speech using various articulatory acquisition techniques as input (e.g. ultrasound tongue imaging, MRI, lip vid…

cs.SD2021★ 12 cited

Improving Neural Silent Speech Interface Models by Adversarial Training

Amin Honarmandi Shandiz, László Tóth, Gábor Gosztolya +2

Besides the well-known classification task, these days neural networks are frequently being applied to generate or transform data, such as images and audio signals. In such tasks,…

cs.CV2021★ 2 cited

Convolutional Neural Network-Based Age Estimation Using B-Mode Ultrasound Tongue Image

Kele Xu, Tamas Gábor Csapó, Ming Feng

Ultrasound tongue imaging is widely used for speech production research, and it has attracted increasing attention as its potential applications seem to be evident in many differen…

eess.AS2020

Ultrasound-based Articulatory-to-Acoustic Mapping with WaveGlow Speech Synthesis

Tamás Gábor Csapó, Csaba Zainkó, László Tóth +2

For articulatory-to-acoustic mapping using deep neural networks, typically spectral and excitation parameters of vocoders have been used as the training targets. However, vocoding…

eess.AS2020★ 2 cited

Quantification of Transducer Misalignment in Ultrasound Tongue Imaging

Tamás Gábor Csapó, Kele Xu

In speech production research, different imaging modalities have been employed to obtain accurate information about the movement and shaping of the vocal tract. Ultrasound is an af…

eess.AS2020

Speaker dependent acoustic-to-articulatory inversion using real-time MRI of the vocal tract

Tamás Gábor Csapó

Acoustic-to-articulatory inversion (AAI) methods estimate articulatory movements from the acoustic speech signal, which can be useful in several tasks such as speech recognition, s…

eess.AS2020

Speaker dependent articulatory-to-acoustic mapping using real-time MRI of the vocal tract

Tamás Gábor Csapó

Articulatory-to-acoustic (forward) mapping is a technique to predict speech using various articulatory acquisition techniques (e.g. ultrasound tongue imaging, lip video). Real-time…