32 citations · 127 across the 12 of their papers we have counts for
12 papers
BEANS: The Benchmark of Animal Sounds
Masato Hagiwara, Benjamin Hoffman, Jen-Yu Liu +3
The use of machine learning (ML) based techniques has become increasingly popular in the field of bioacoustics over the last years. Fundamental requirements for the successful appl…
Modeling Animal Vocalizations through Synthesizers
Masato Hagiwara, Maddie Cusimano, Jen-Yu Liu
Modeling real-world sound is a fundamental problem in the creative use of machine learning and many other fields, including human speech processing and bioacoustics. Transformer-ba…
KaraSinger: Score-Free Singing Voice Synthesis with VQ-VAE using Mel-spectrograms
Chien-Feng Liao, Jen-Yu Liu, Yi-Hsuan Yang
In this paper, we propose a novel neural network model called KaraSinger for a less-studied singing voice synthesis (SVS) task named score-free SVS, in which the prosody and melody…
Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs
Wen-Yi Hsiao, Jen-Yu Liu, Yin-Cheng Yeh +1
To apply neural sequence models such as the Transformers to music generation tasks, one has to represent a piece of music by a sequence of tokens drawn from a finite set of pre-def…
Unconditional Audio Generation with Generative Adversarial Networks and Cycle Regularization
Jen-Yu Liu, Yu-Hua Chen, Yin-Cheng Yeh +1
In a recent paper, we have presented a generative adversarial network (GAN)-based model for unconditional generation of the mel-spectrograms of singing voices. As the generator of…
Score and Lyrics-Free Singing Voice Generation
Jen-Yu Liu, Yu-Hua Chen, Yin-Cheng Yeh +1
Generative models for singing voice have been mostly concerned with the task of ``singing voice synthesis,'' i.e., to produce singing voice waveforms given musical scores and text…
Dilated Convolution with Dilated GRU for Music Source Separation
Jen-Yu Liu, Yi-Hsuan Yang
Stacked dilated convolutions used in Wavenet have been shown effective for generating high-quality audios. By replacing pooling/striding with dilation in convolution layers, they c…
Singing Style Transfer Using Cycle-Consistent Boundary Equilibrium Generative Adversarial Networks
Cheng-Wei Wu, Jen-Yu Liu, Yi-Hsuan Yang +1
Can we make a famous rap singer like Eminem sing whatever our favorite song? Singing style transfer attempts to make this possible, by replacing the vocal of a song from the source…
Denoising Auto-encoder with Recurrent Skip Connections and Residual Regression for Music Source Separation
Jen-Yu Liu, Yi-Hsuan Yang
Convolutional neural networks with skip connections have shown good performance in music source separation. In this work, we propose a denoising Auto-encoder with Recurrent skip Co…
Weakly-supervised Visual Instrument-playing Action Detection in Videos
Jen-Yu Liu, Yi-Hsuan Yang, Shyh-Kang Jeng
Instrument playing is among the most common scenes in music-related videos, which represent nowadays one of the largest sources of online videos. In order to understand the instrum…
Revisiting the problem of audio-based hit song prediction using convolutional neural networks
Li-Chia Yang, Szu-Yu Chou, Jen-Yu Liu +2
Being able to predict whether a song can be a hit has impor- tant applications in the music industry. Although it is true that the popularity of a song can be greatly affected by e…
Applying Topological Persistence in Convolutional Neural Network for Music Audio Signals
Jen-Yu Liu, Shyh-Kang Jeng, Yi-Hsuan Yang
Recent years have witnessed an increased interest in the application of persistent homology, a topological tool for data analysis, to machine learning problems. Persistent homology…