55 citations · 117 across the 27 of their papers we have counts for
8 papers · 1 filter
The effectiveness of unsupervised subword modeling with autoregressive and cross-lingual phone-aware networks
Siyuan Feng, Odette Scharenborg
This study addresses unsupervised subword modeling, i.e., learning acoustic feature representations that can distinguish between subword units of a language. We propose a two-stage…
Show and Speak: Directly Synthesize Spoken Description of Images
Xinsheng Wang, Siyuan Feng, Jihua Zhu +2
This paper proposes a new model, referred to as the show and speak (SAS) model that, for the first time, is able to directly synthesize spoken descriptions of images, bypassing the…
The CUHK-TUDELFT System for The SLT 2021 Children Speech Recognition Challenge
Si-Ioi Ng, Wei Liu, Zhiyuan Peng +4
This technical report describes our submission to the 2021 SLT Children Speech Recognition Challenge (CSRC) Track 1. Our approach combines the use of a joint CTC-attention end-to-e…
How Phonotactics Affect Multilingual and Zero-shot ASR Performance
Siyuan Feng, Piotr Żelasko, Laureano Moro-Velázquez +4
The idea of combining multiple languages' recordings to train a single automatic speech recognition (ASR) model brings the promise of the emergence of universal speech representati…
Unsupervised Subword Modeling Using Autoregressive Pretraining and Cross-Lingual Phone-Aware Modeling
Siyuan Feng, Odette Scharenborg
This study addresses unsupervised subword modeling, i.e., learning feature representations that can distinguish subword units of a language. The proposed approach adopts a two-stag…
Evaluating Automatically Generated Phoneme Captions for Images
Justin van der Hout, Zoltán D'Haese, Mark Hasegawa-Johnson +1
Image2Speech is the relatively new task of generating a spoken description of an image. This paper presents an investigation into the evaluation of this task. For this, first an Im…
That Sounds Familiar: an Analysis of Phonetic Representations Transfer Across Languages
Piotr Żelasko, Laureano Moro-Velázquez, Mark Hasegawa-Johnson +2
Only a handful of the world's languages are abundant with the resources that enable practical applications of speech processing technologies. One of the methods to overcome this pr…
S2IGAN: Speech-to-Image Generation via Adversarial Learning
Xinsheng Wang, Tingting Qiao, Jihua Zhu +2
An estimated half of the world's languages do not have a written form, making it impossible for these languages to benefit from any existing text-based technologies. In this paper,…