24 citations · 69 across the 23 of their papers we have counts for
23 papers
Local Equivariance Error-Based Metrics for Evaluating Sampling-Frequency-Independent Property of Neural Network
Kanami Imamura, Tomohiko Nakamura, Norihiro Takamune +2
Audio signal processing methods based on deep neural networks (DNNs) are typically trained only at a single sampling frequency (SF) and therefore require signal resampling to handl…
FruitsMusic: A Real-World Corpus of Japanese Idol-Group Songs
Hitoshi Suda, Shunsuke Yoshida, Tomohiko Nakamura +2
This study presents FruitsMusic, a metadata corpus of Japanese idol-group songs in the real world, precisely annotated with who sings what and when. Japanese idol-group songs, vita…
DNN-based ensemble singing voice synthesis with interactions between singers
Hiroaki Hyodo, Shinnosuke Takamichi, Tomohiko Nakamura +2
We propose a singing voice synthesis (SVS) method for a more unified ensemble singing voice by modeling interactions between singers. Most existing SVS methods aim to synthesize a…
Self-Supervised Speech Representations are More Phonetic than Semantic
Kwanghee Choi, Ankita Pasad, Tomohiko Nakamura +3
Self-supervised speech models (S3Ms) have become an effective backbone for speech applications. Various analyses suggest that S3Ms encode linguistic properties. In this work, we se…
Neural Blind Source Separation and Diarization for Distant Speech Recognition
Yoshiaki Bando, Tomohiko Nakamura, Shinji Watanabe
This paper presents a neural method for distant speech recognition (DSR) that jointly separates and diarizes speech mixtures without supervision by isolated signals. A standard sep…
Real-time Speech Extraction Using Spatially Regularized Independent Low-rank Matrix Analysis and Rank-constrained Spatial Covariance Matrix Estimation
Yuto Ishikawa, Kohei Konaka, Tomohiko Nakamura +2
Real-time speech extraction is an important challenge with various applications such as speech recognition in a human-like avatar/robot. In this paper, we propose the real-time ext…
Algorithms of Sampling-Frequency-Independent Layers for Non-integer Strides
Kanami Imamura, Tomohiko Nakamura, Norihiro Takamune +2
In this paper, we propose algorithms for handling non-integer strides in sampling-frequency-independent (SFI) convolutional and transposed convolutional layers. The SFI layers have…
How Generative Spoken Language Modeling Encodes Noisy Speech: Investigation from Phonetics to Syntactics
Joonyong Park, Shinnosuke Takamichi, Tomohiko Nakamura +3
We examine the speech modeling potential of generative spoken language modeling (GSLM), which involves using learned symbols derived from data rather than phonemes for speech analy…
JaCappella Corpus: A Japanese a Cappella Vocal Ensemble Corpus
Tomohiko Nakamura, Shinnosuke Takamichi, Naoko Tanji +2
We construct a corpus of Japanese a cappella vocal ensembles (jaCappella corpus) for vocal ensemble separation and synthesis. It consists of 35 copyright-cleared vocal ensemble son…
Hyperbolic Timbre Embedding for Musical Instrument Sound Synthesis Based on Variational Autoencoders
Futa Nakashima, Tomohiko Nakamura, Norihiro Takamune +2
In this paper, we propose a musical instrument sound synthesis (MISS) method based on a variational autoencoder (VAE) that has a hierarchy-inducing latent space for timbre. VAE-bas…
Head-Related Transfer Function Interpolation from Spatially Sparse Measurements Using Autoencoder with Source Position Conditioning
Yuki Ito, Tomohiko Nakamura, Shoichi Koyama +1
We propose a method of head-related transfer function (HRTF) interpolation from sparsely measured HRTFs using an autoencoder with source position conditioning. The proposed method…
Physics-informed convolutional neural network with bicubic spline interpolation for sound field estimation
Kazuhide Shigemi, Shoichi Koyama, Tomohiko Nakamura +1
A sound field estimation method based on a physics-informed convolutional neural network (PICNN) using spline interpolation is proposed. Most of the sound field estimation methods…
SelfRemaster: Self-Supervised Speech Restoration with Analysis-by-Synthesis Approach Using Channel Modeling
Takaaki Saeki, Shinnosuke Takamichi, Tomohiko Nakamura +2
We present a self-supervised speech restoration method without paired speech corpora. Because the previous general speech restoration method uses artificial paired data created by…
Differentiable Digital Signal Processing Mixture Model for Synthesis Parameter Extraction from Mixture of Harmonic Sounds
Masaya Kawamura, Tomohiko Nakamura, Daichi Kitamura +3
A differentiable digital signal processing (DDSP) autoencoder is a musical sound synthesizer that combines a deep neural network (DNN) and spectral modeling synthesis. It allows us…
Speech Enhancement by Noise Self-Supervised Rank-Constrained Spatial Covariance Matrix Estimation via Independent Deeply Learned Matrix Analysis
Sota Misawa, Norihiro Takamune, Tomohiko Nakamura +4
Rank-constrained spatial covariance matrix estimation (RCSCME) is a method for the situation that the directional target speech and the diffuse noise are mixed. In conventional RCS…
Multichannel Audio Source Separation with Independent Deeply Learned Matrix Analysis Using Product of Source Models
Takuya Hasumi, Tomohiko Nakamura, Norihiro Takamune +4
Independent deeply learned matrix analysis (IDLMA) is one of the state-of-the-art multichannel audio source separation methods using the source power estimation based on deep neura…
Prior Distribution Design for Music Bleeding-Sound Reduction Based on Nonnegative Matrix Factorization
Yusaku Mizobuchi, Daichi Kitamura, Tomohiko Nakamura +3
When we place microphones close to a sound source near other sources in audio recording, the obtained audio signal includes undesired sound from the other sources, which is often c…
Independent Deeply Learned Tensor Analysis for Determined Audio Source Separation
Naoki Narisawa, Rintaro Ikeshita, Norihiro Takamune +4
We address the determined audio source separation problem in the time-frequency domain. In independent deeply learned matrix analysis (IDLMA), it is assumed that the inter-frequenc…
Empirical Bayesian Independent Deeply Learned Matrix Analysis For Multichannel Audio Source Separation
Takuya Hasumi, Tomohiko Nakamura, Norihiro Takamune +4
Independent deeply learned matrix analysis (IDLMA) is one of the state-of-the-art supervised multichannel audio source separation methods. It blindly estimates the demixing filters…
Sampling-Frequency-Independent Audio Source Separation Using Convolution Layer Based on Impulse Invariant Method
Koichi Saito, Tomohiko Nakamura, Kohei Yatabe +2
Audio source separation is often used as preprocessing of various applications, and one of its ultimate goals is to construct a single versatile model capable of dealing with the v…
Time-Domain Audio Source Separation Based on Wave-U-Net Combined with Discrete Wavelet Transform
Tomohiko Nakamura, Hiroshi Saruwatari
We propose a time-domain audio source separation method using down-sampling (DS) and up-sampling (US) layers based on a discrete wavelet transform (DWT). The proposed method is bas…
Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips
Tomohiko Nakamura, Eita Nakamura, Shigeki Sagayama
This paper discusses real-time alignment of audio signals of music performance to the corresponding score (a.k.a. score following) which can handle tempo changes, errors and arbitr…
Outer-Product Hidden Markov Model and Polyphonic MIDI Score Following
Eita Nakamura, Tomohiko Nakamura, Yasuyuki Saito +2
We present a polyphonic MIDI score-following algorithm capable of following performances with arbitrary repeats and skips, based on a probabilistic model of musical performances. I…