111 citations · 552 across the 49 of their papers we have counts for
10 papers · 1 filter
Simultaneous Speech-to-Speech Translation System with Neural Incremental ASR, MT, and TTS
Katsuhito Sudoh, Takatomo Kano, Sashi Novitasari +3
This paper presents a newly developed, simultaneous neural speech-to-speech translation system and its evaluation. The system consists of three fully-incremental neural processing…
Cross-Lingual Machine Speech Chain for Javanese, Sundanese, Balinese, and Bataks Speech Recognition and Synthesis
Sashi Novitasari, Andros Tjandra, Sakriani Sakti +1
Even though over seven hundred ethnic languages are spoken in Indonesia, the available technology remains limited that could support communication within indigenous communities as…
Sequence-to-Sequence Learning via Attention Transfer for Incremental Speech Recognition
Sashi Novitasari, Andros Tjandra, Sakriani Sakti +1
Attention-based sequence-to-sequence automatic speech recognition (ASR) requires a significant delay to recognize long utterances because the output is generated after receiving en…
Incremental Machine Speech Chain Towards Enabling Listening while Speaking in Real-time
Sashi Novitasari, Andros Tjandra, Tomoya Yanagita +2
Inspired by a human speech chain mechanism, a machine speech chain framework based on deep learning was recently proposed for the semi-supervised development of automatic speech re…
Augmenting Images for ASR and TTS through Single-loop and Dual-loop Multimodal Chain Framework
Johanes Effendi, Andros Tjandra, Sakriani Sakti +1
Previous research has proposed a machine speech chain to enable automatic speech recognition (ASR) and text-to-speech synthesis (TTS) to assist each other in semi-supervised learni…
Image Captioning with Visual Object Representations Grounded in the Textual Modality
Dušan Variš, Katsuhito Sudoh, Satoshi Nakamura
We present our work in progress exploring the possibilities of a shared embedding space between textual and visual modality. Leveraging the textual nature of object detection label…
Reflection-based Word Attribute Transfer
Yoichi Ishibashi, Katsuhito Sudoh, Koichiro Yoshino +1
Word embeddings, which often represent such analogic relations as king - man + woman = queen, can be used to change a word's attribute, including its gender. For transferring king…
ReMOTS: Self-Supervised Refining Multi-Object Tracking and Segmentation
Fan Yang, Xin Chang, Chenyu Dang +4
We aim to improve the performance of Multiple Object Tracking and Segmentation (MOTS) by refinement. However, it remains challenging for refining MOTS results, which could be attri…
Transformer VQ-VAE for Unsupervised Unit Discovery and Speech Synthesis: ZeroSpeech 2020 Challenge
Andros Tjandra, Sakriani Sakti, Satoshi Nakamura
In this paper, we report our submitted system for the ZeroSpeech 2020 challenge on Track 2019. The main theme in this challenge is to build a speech synthesizer without any textual…
Caption Generation of Robot Behaviors based on Unsupervised Learning of Action Segments
Koichiro Yoshino, Kohei Wakimoto, Yuta Nishimura +1
Bridging robot action sequences and their natural language captions is an important task to increase explainability of human assisting robots in their recently evolving field. In t…