WaveNet: A Generative Model for Raw Audio

Abstract

This paper introduces WaveNet, a deep neural network for generating raw audio waveforms. The model is fully probabilistic and autoregressive, with the predictive distribution for each audio sample conditioned on all previous ones; nonetheless we show that it can be efficiently trained on data with tens of thousands of samples per second of audio. When applied to text-to-speech, it yields state-of-the-art performance, with human listeners rating it as significantly more natural sounding than the best parametric and concatenative systems for both English and Mandarin. A single WaveNet can capture the characteristics of many different speakers with equal fidelity, and can switch between them by conditioning on the speaker identity. When trained to model music, we find that it generates novel and often highly realistic musical fragments. We also show that it can be employed as a discriminative model, returning promising results for phoneme recognition.

Cited by in corpus (829)

• Denoising Diffusion Probabilistic Models
• An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
• Geometric deep learning: going beyond Euclidean data
• On the Opportunities and Risks of Foundation Models
• Longformer: The Long-Document Transformer
• Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separation
• Time Series Forecasting With Deep Learning: A Survey
• Over the Air Deep Learning Based Radio Signal Classification
• Progressive Growing of GANs for Improved Quality, Stability, and Variation
• Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directions
• NIPS 2016 Tutorial: Generative Adversarial Networks
• Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting
• Generative Modeling by Estimating Gradients of the Data Distribution
• The frontier of simulation-based inference
• Deep Learning for Audio Signal Processing
• An Empirical Survey of Data Augmentation for Time Series Classification with Neural Networks
• Deep Learning-based Vehicle Behaviour Prediction For Autonomous Driving Applications: A Review
• Adversarially Learned Inference
• Recent Advances in Recurrent Neural Networks
• FastSpeech: Fast, Robust and Controllable Text to Speech
• Towards Explainable Artificial Intelligence
• Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesis
• FastSpeech 2: Fast and High-Quality End-to-End Text to Speech
• Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting
• Multimodal Intelligence: Representation Learning, Information Fusion, and Applications
• Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
• Generating Long Sequences with Sparse Transformers
• The State of Sparsity in Deep Neural Networks
• Predicting Process Behaviour using Deep Learning
• Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis
• Computational bioacoustics with deep learning: a review and roadmap
• Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders
• Aggregated Residual Transformations for Deep Neural Networks
• Deep-Learning Inversion of Seismic Data
• How Generative Adversarial Networks and Their Variants Work: An Overview
• Deep Learning for Real-time Gravitational Wave Detection and Parameter Estimation: Results with Advanced LIGO Data
• Deep Learning for Time Series Forecasting: Tutorial and Literature Survey
• Normalizing Flows for Probabilistic Modeling and Inference
• Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A survey
• Recent Advances in Convolutional Neural Networks
• A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music
• GAN-Leaks: A Taxonomy of Membership Inference Attacks against Generative Models
• MidiNet: A Convolutional Generative Adversarial Network for Symbolic-domain Music Generation
• Efficiently Trainable Text-to-Speech System Based on Deep Convolutional Networks with Guided Attention
• Deep Neural Networks to Enable Real-time Multimessenger Astrophysics
• Differentiable Learning of Quantum Circuit Born Machine
• How to Build a Graph-Based Deep Learning Architecture in Traffic Domain: A Survey
• Neural Granger Causality
• An overview and comparative analysis of Recurrent Neural Networks for Short Term Load Forecasting
• Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx
• Identification of Deep Network Generated Images Using Disparities in Color Components
• A Multi-Horizon Quantile Recurrent Forecaster
• Model compression via distillation and quantization
• Var-CNN: A Data-Efficient Website Fingerprinting Attack Based on Deep Learning
• Machine Learning for Microcontroller-Class Hardware: A Review
• SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interaction
• GANSynth: Adversarial Neural Audio Synthesis
• Syntax-Directed Variational Autoencoder for Structured Data
• Unsupervised Scalable Representation Learning for Multivariate Time Series
• Adversarial Examples: Attacks and Defenses for Deep Learning
• Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning
• Training of Quantum Circuits on a Hybrid Quantum Computer
• Learning to Predict the Cosmological Structure Formation
• Cognitive Science in the era of Artificial Intelligence: A roadmap for reverse-engineering the infant language-learner
• Deep Voice 2: Multi-Speaker Neural Text-to-Speech
• Coronary Artery Centerline Extraction in Cardiac CT Angiography Using a CNN-Based Orientation Classifier
• Deep Unsupervised Cardinality Estimation
• Spatio-Temporal Wind Speed Forecasting using Graph Networks and Novel Transformer Architectures
• Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search
• Masked Autoregressive Flow for Density Estimation
• AUTOVC: Zero-Shot Voice Style Transfer with Only Autoencoder Loss
• QuaterNet: A Quaternion-based Recurrent Model for Human Motion
• Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions
• Neural Voice Cloning with a Few Samples
• ST-GRAT: A Novel Spatio-temporal Graph Attention Network for Accurately Forecasting Dynamically Changing Road Speed
• Glow: Generative Flow with Invertible 1x1 Convolutions
• Multi-level Convolutional Autoencoder Networks for Parametric Prediction of Spatio-temporal Dynamics
• Improving Variational Inference with Inverse Autoregressive Flow
• Dynamical Variational Autoencoders: A Comprehensive Review
• An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution
• Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art
• Causal Contextual Prediction for Learned Image Compression
• Gravitational-wave parameter estimation with autoregressive neural network flows
• Mining gold from implicit models to improve likelihood-free inference
• Compressed Sensing with Deep Image Prior and Learned Regularization
• Invertible Residual Networks
• Multimodal Machine Learning: A Survey and Taxonomy
• Bayesian-Deep-Learning Estimation of Earthquake Location from Single-Station Observations
• Generating Handwritten Chinese Characters using CycleGAN
• Non-local Neural Networks
• Meta-learning with differentiable closed-form solvers
• Convolutional neural networks: a magic bullet for gravitational-wave detection?
• Tacotron: Towards End-to-End Speech Synthesis
• A Guide to Constraining Effective Field Theories with Machine Learning
• Deep Transfer Learning for Automatic Speech Recognition: Towards Better Generalization
• Neural Network Renormalization Group
• Lipschitz regularity of deep neural networks: analysis and efficient estimation
• Emotion Recognition From Speech With Recurrent Neural Networks
• NeuroBEM: Hybrid Aerodynamic Quadrotor Model
• Fast Spectrogram Inversion using Multi-head Convolutional Neural Networks
• Multi-Person Continuous Tracking and Identification from mm-Wave micro-Doppler Signatures
• At the Dawn of Generative AI Era: A Tutorial-cum-Survey on New Frontiers in 6G Wireless Intelligence
• STConvS2S: Spatiotemporal Convolutional Sequence to Sequence Network for Weather Forecasting
• Low Bit-Rate Speech Coding with VQ-VAE and a WaveNet Decoder
• BIVA: A Very Deep Hierarchy of Latent Variables for Generative Modeling
• Recent Advances in Deep Learning: An Overview
• TeaNet: universal neural network interatomic potential inspired by iterative electronic relaxations
• DTAAD: Dual Tcn-Attention Networks for Anomaly Detection in Multivariate Time Series Data
• A Comparison of Discrete and Soft Speech Units for Improved Voice Conversion
• Light-Weight RefineNet for Real-Time Semantic Segmentation
• Gravitational Wave Denoising of Binary Black Hole Mergers with Deep Learning
• Rethinking CNN Models for Audio Classification
• One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning
• Sample-level Deep Convolutional Neural Networks for Music Auto-tagging Using Raw Waveforms
• Sample Efficient Adaptive Text-to-Speech
• Deceiving End-to-End Deep Learning Malware Detectors using Adversarial Examples
• Scalable Population Synthesis with Deep Generative Modeling
• Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning
• The Conditional Entropy Bottleneck
• F0-consistent many-to-many non-parallel voice conversion via conditional autoencoder
• Generative Models for Automatic Chemical Design
• Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecasting
• Trellis Networks for Sequence Modeling
• DurIAN: Duration Informed Attention Network For Multimodal Synthesis
• Improved Variational Autoencoders for Text Modeling using Dilated Convolutions
• Stable Recurrent Models
• Learning and Inference on Generative Adversarial Quantum Circuits
• R-Transformer: Recurrent Neural Network Enhanced Transformer
• Short-Term Electricity-Load Forecasting by Deep Learning: A Comprehensive Survey
• Learning to dance: A graph convolutional adversarial network to generate realistic dance motions from audio
• Interpretable Convolutional Filters with SincNet
• Towards a universal neural network encoder for time series
• Generating Visually Aligned Sound from Videos
• InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset
• An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Era
• Fully Convolutional Speech Recognition
• Learning Montezuma's Revenge from a Single Demonstration
• Machine Learning for Spatiotemporal Sequence Forecasting: A Survey
• Mining for Dark Matter Substructure: Inferring subhalo population properties from strong lenses with machine learning
• Learning Memory Access Patterns
• Lip-reading with Densely Connected Temporal Convolutional Networks
• Nonparallel Emotional Speech Conversion
• Taskmaster-1: Toward a Realistic and Diverse Dialog Dataset
• Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encoder
• Learning Sparse Networks Using Targeted Dropout
• A Tutorial on Deep Learning for Music Information Retrieval
• Efficient Neural Audio Synthesis
• Gated-Dilated Networks for Lung Nodule Classification in CT scans
• Detection of gravitational-wave signals from binary neutron star mergers using machine learning
• Audio style transfer
• The unreasonable effectiveness of the forget gate
• Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows
• DeepTrack: Lightweight Deep Learning for Vehicle Path Prediction in Highways
• CNN+CNN: Convolutional Decoders for Image Captioning
• Neural Abstractive Text Summarization with Sequence-to-Sequence Models
• Deep Representation Learning in Speech Processing: Challenges, Recent Advances, and Future Trends
• Multi-level Residual Networks from Dynamical Systems View
• Failures of Gradient-Based Deep Learning
• CopyCat: Many-to-Many Fine-Grained Prosody Transfer for Neural Text-to-Speech
• Waveform Modeling and Generation Using Hierarchical Recurrent Neural Networks for Speech Bandwidth Extension
• Audio-Visual Speech Separation and Dereverberation with a Two-Stage Multimodal Network
• PolyGen: An Autoregressive Generative Model of 3D Meshes
• Expression Analysis Based on Face Regions in Read-world Conditions
• Variational Temporal Deep Generative Model for Radar HRRP Target Recognition
• MIDI-VAE: Modeling Dynamics and Instrumentation of Music with Applications to Style Transfer
• ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech
• SELD-TCN: Sound Event Localization & Detection via Temporal Convolutional Networks
• Deep Learning for Environmentally Robust Speech Recognition: An Overview of Recent Developments
• Hierarchical Representation Learning in Graph Neural Networks with Node Decimation Pooling
• Abstractive Summarization of Reddit Posts with Multi-level Memory Networks
• Real-Time Well Log Prediction From Drilling Data Using Deep Learning
• Acoustic Anomaly Detection for Machine Sounds based on Image Transfer Learning
• CrossTransformers: spatially-aware few-shot transfer
• A Survey of Deep Learning for Scientific Discovery
• Synthetic Lagrangian Turbulence by Generative Diffusion Models
• Demucs: Deep Extractor for Music Sources with extra unlabeled data remixed
• Pervasive Attention: 2D Convolutional Neural Networks for Sequence-to-Sequence Prediction
• WaveFlow: A Compact Flow-based Model for Raw Audio
• Continuous Human Action Recognition for Human-Machine Interaction: A Review
• SRECG: ECG Signal Super-resolution Framework for Portable/Wearable Devices in Cardiac Arrhythmias Classification
• Small Sample Learning in Big Data Era
• Bit-Swap: Recursive Bits-Back Coding for Lossless Compression with Hierarchical Latent Variables
• Do Deep Generative Models Know What They Don't Know?
• WGANSing: A Multi-Voice Singing Voice Synthesizer Based on the Wasserstein-GAN
• Improved Speech Enhancement with the Wave-U-Net
• GACELA -- A generative adversarial context encoder for long audio inpainting
• High Accuracy and High Fidelity Extraction of Neural Networks
• Meta-TTS: Meta-Learning for Few-Shot Speaker Adaptive Text-to-Speech
• Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Review
• Theory and Experiments on Vector Quantized Autoencoders
• GeneraLight: Improving Environment Generalization of Traffic Signal Control via Meta Reinforcement Learning
• Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learning
• Generating Multi-Agent Trajectories using Programmatic Weak Supervision
• End-to-End Video-To-Speech Synthesis using Generative Adversarial Networks
• Forecast Network-Wide Traffic States for Multiple Steps Ahead: A Deep Learning Approach Considering Dynamic Non-Local Spatial Correlation and Non-Stationary Temporal Dependency
• Constrained Bayesian Optimization for Automatic Chemical Design
• Deep Learning Ensemble for Real-time Gravitational Wave Detection of Spinning Binary Black Hole Mergers
• Edge Intelligence: On-Demand Deep Learning Model Co-Inference with Device-Edge Synergy
• Generative adversarial network-based glottal waveform model for statistical parametric speech synthesis
• Multi-modal Fusion for Single-Stage Continuous Gesture Recognition
• Beyond exploding and vanishing gradients: analysing RNN training using attractors and smoothness
• The Emotional Voices Database: Towards Controlling the Emotion Dimension in Voice Generation Systems
• Blow: a single-scale hyperconditioned flow for non-parallel raw-audio voice conversion
• Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradients
• Complex-valued neural networks for machine learning on non-stationary physical data
• Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services
• Efficient Processing of Deep Neural Networks: A Tutorial and Survey
• ATISS: Autoregressive Transformers for Indoor Scene Synthesis
• Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals
• Music Genre Classification using Machine Learning Techniques
• StarGAN-VC: Non-parallel many-to-many voice conversion with star generative adversarial networks
• Learning physical properties of anomalous random walks using graph neural networks
• Machine learning astrophysics from 21 cm lightcones: impact of network architectures and signal contamination
• Augmented Cyclic Adversarial Learning for Low Resource Domain Adaptation
• Effective Use of Variational Embedding Capacity in Expressive End-to-End Speech Synthesis
• Detection of Gravitational Waves Using Bayesian Neural Networks
• Geometric deep learning for computational mechanics Part II: Graph embedding for interpretable multiscale plasticity
• Hierarchical Generative Modeling for Controllable Speech Synthesis
• Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting
• VQTTS: High-Fidelity Text-to-Speech Synthesis with Self-Supervised VQ Acoustic Feature
• Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech
• PreBit -- A multimodal model with Twitter FinBERT embeddings for extreme price movement prediction of Bitcoin
• Onsets and Frames: Dual-Objective Piano Transcription
• Generative adversarial interpolative autoencoding: adversarial training on latent space interpolations encourage convex latent distributions
• Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognition
• Learning the Travelling Salesperson Problem Requires Rethinking Generalization
• JVS corpus: free Japanese multi-speaker voice corpus
• Training Neural Speech Recognition Systems with Synthetic Speech Augmentation
• Advbox: a toolbox to generate adversarial examples that fool neural networks
• Look, Listen and Learn
• Dynamical mass inference of galaxy clusters with neural flows
• Neural Networks Versus Conventional Filters for Inertial-Sensor-based Attitude Estimation
• Temporal Convolutional Attention-based Network For Sequence Modeling
• TasNet: time-domain audio separation network for real-time, single-channel speech separation
• Unsupervised Model Selection for Variational Disentangled Representation Learning
• A Survey of Machine Learning Methods and Challenges for Windows Malware Classification
• LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Reading
• Adversarial Training in Affective Computing and Sentiment Analysis: Recent Advances and Perspectives
• Assume, Augment and Learn: Unsupervised Few-Shot Meta-Learning via Random Labels and Data Augmentation
• Raw Waveform-based Speech Enhancement by Fully Convolutional Networks
• Listen to Dance: Music-driven choreography generation using Autoregressive Encoder-Decoder Network
• Toward Interpretable Music Tagging with Self-Attention
• Universal Adversarial Audio Perturbations
• GhostTalk: Interactive Attack on Smartphone Voice System Through Power Line
• Analyzing γ-rays of the Galactic Center with Deep Learning
• Spatial-temporal Conv-sequence Learning with Accident Encoding for Traffic Flow Prediction
• End-to-End Adversarial Text-to-Speech
• Improving Sequence-to-Sequence Acoustic Modeling by Adding Text-Supervision
• Audeo: Audio Generation for a Silent Performance Video
• Accuracy of neural networks for the simulation of chaotic dynamics: precision of training data vs precision of the algorithm
• Zero-shot Knowledge Transfer via Adversarial Belief Matching
• Adaptive Music Composition for Games
• On the Evaluation of Conditional GANs
• Spherical Latent Spaces for Stable Variational Autoencoders
• Autoregressive Quantile Networks for Generative Modeling
• Open Challenges in Synthetic Speech Detection
• Short-term daily precipitation forecasting with seasonally-integrated autoencoder
• Psychoacoustic Calibration of Loss Functions for Efficient End-to-End Neural Audio Coding
• KazakhTTS: An Open-Source Kazakh Text-to-Speech Synthesis Dataset
• Self-Supervised VQ-VAE for One-Shot Music Style Transfer
• The Effect of Explicit Structure Encoding of Deep Neural Networks for Symbolic Music Generation
• VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generation
• Inference-optimized AI and high performance computing for gravitational wave detection at scale
• Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detection
• Modeling Multi-speaker Latent Space to Improve Neural TTS: Quick Enrolling New Speaker and Enhancing Premium Voice
• Short-Term Density Forecasting of Low-Voltage Load using Bernstein-Polynomial Normalizing Flows
• Quasi-Periodic WaveNet: An Autoregressive Raw Waveform Generative Model with Pitch-dependent Dilated Convolution Neural Network
• Real-Time Likelihood-Free Inference of Roman Binary Microlensing Events with Amortized Neural Posterior Estimation
• Semantic Hearing: Programming Acoustic Scenes with Binaural Hearables
• A Novel Temporal Multi-Gate Mixture-of-Experts Approach for Vehicle Trajectory and Driving Intention Prediction
• Synthesis of Realistic ECG using Generative Adversarial Networks
• FloWaveNet : A Generative Flow for Raw Audio
• Deep MOS Predictor for Synthetic Speech Using Cluster-Based Modeling
• iNNvestigate neural networks!
• NMR spectrum reconstruction as a pattern recognition problem
• An Initial Investigation for Detecting Vocoder Fingerprints of Fake Audio
• Weakly Supervised Multi-Task Representation Learning for Human Activity Analysis Using Wearables
• The Indirect Convolution Algorithm
• Neural Spline Flows
• Semi-supervised source localization with deep generative modeling
• Singing voice synthesis based on convolutional neural networks
• Generating 3D faces using Convolutional Mesh Autoencoders
• Towards a Robust Deep Neural Network in Texts: A Survey
• An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learning
• Generating equilibrium molecules with deep neural networks
• Motion Switching with Sensory and Instruction Signals by designing Dynamical Systems using Deep Neural Network
• Bilinear Representation for Language-based Image Editing Using Conditional Generative Adversarial Networks
• Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloning
• Scalable and Efficient Neural Speech Coding: A Hybrid Design
• High Quality Prediction of Protein Q8 Secondary Structure by Diverse Neural Network Architectures
• Audio inpainting with generative adversarial network
• High Quality Streaming Speech Synthesis with Low, Sentence-Length-Independent Latency
• Physics-inspired deep learning to characterize the signal manifold of quasi-circular, spinning, non-precessing binary black hole mergers
• GDP: Generalized Device Placement for Dataflow Graphs
• Parallelizing Linear Recurrent Neural Nets Over Sequence Length
• NeuroCard: One Cardinality Estimator for All Tables
• Sequence Tutor: Conservative Fine-Tuning of Sequence Generation Models with KL-control
• On Extractive and Abstractive Neural Document Summarization with Transformer Language Models
• SNR-Based Features and Diverse Training Data for Robust DNN-Based Speech Enhancement
• Imputer: Sequence Modelling via Imputation and Dynamic Programming
• NU-GAN: High resolution neural upsampling with GAN
• Latent-Domain Predictive Neural Speech Coding
• LAVARNET: Neural Network Modeling of Causal Variable Relationships for Multivariate Time Series Forecasting
• Towards Robust Neural Vocoding for Speech Generation: A Survey
• FastWave: Accelerating Autoregressive Convolutional Neural Networks on FPGA
• TFGAN: Time and Frequency Domain Based Generative Adversarial Network for High-fidelity Speech Synthesis
• Explaining Deep Classification of Time-Series Data with Learned Prototypes
• Themis: Fair and Efficient GPU Cluster Scheduling
• NewsPod: Automatic and Interactive News Podcasts
• Sales forecasting using WaveNet within the framework of the Kaggle competition
• WavThruVec: Latent speech representation as intermediate features for neural speech synthesis
• Autoencoders for music sound modeling: a comparison of linear, shallow, deep, recurrent and variational models
• Transformer Hawkes Process
• Generative Adversarial Networks Applied to Synthetic Financial Scenarios Generation
• Intensity-Free Learning of Temporal Point Processes
• IoT-based Analysis for Smart Energy Management
• MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series
• CLIP: Cheap Lipschitz Training of Neural Networks
• Multi-band MelGAN: Faster Waveform Generation for High-Quality Text-to-Speech
• Trajectory Space Factorization for Deep Video-Based 3D Human Pose Estimation
• Effective LHC measurements with matrix elements and machine learning
• End-to-end Deep Learning from Raw Sensor Data: Atrial Fibrillation Detection using Wearables
• GRASS: Generative Recursive Autoencoders for Shape Structures
• Efficient Transformer-based Speech Enhancement Using Long Frames and STFT Magnitudes
• Fast Generation for Convolutional Autoregressive Models
• Refined WaveNet Vocoder for Variational Autoencoder Based Voice Conversion
• A Spectral Energy Distance for Parallel Speech Synthesis
• ConvS2S-VC: Fully convolutional sequence-to-sequence voice conversion
• End-to-End Waveform Utterance Enhancement for Direct Evaluation Metrics Optimization by Fully Convolutional Neural Networks
• Taming Visually Guided Sound Generation
• A Deep Generative Model of Speech Complex Spectrograms
• MilliTRACE-IR: Contact Tracing and Temperature Screening via mm-Wave and Infrared Sensing
• HOList: An Environment for Machine Learning of Higher-Order Theorem Proving
• Stochastic WaveNet: A Generative Latent Variable Model for Sequential Data
• HiFi-GAN: High-Fidelity Denoising and Dereverberation Based on Speech Deep Features in Adversarial Networks
• Cross-lingual Multi-speaker Text-to-speech Synthesis for Voice Cloning without Using Parallel Corpus for Unseen Speakers
• PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attention
• Multistage linguistic conditioning of convolutional layers for speech emotion recognition
• LP-WaveNet: Linear Prediction-based WaveNet Speech Synthesis
• Prediction and Control with Temporal Segment Models
• Probabilistic Forecasting with Temporal Convolutional Neural Network
• Dilated convolution with learnable spacings
• Deep Efficient Continuous Manifold Learning for Time Series Modeling
• Preech: A System for Privacy-Preserving Speech Transcription
• Generative timbre spaces: regularizing variational auto-encoders with perceptual metrics
• GAN-Aimbots: Using Machine Learning for Cheating in First Person Shooters
• Enhancement Of Coded Speech Using a Mask-Based Post-Filter
• Likelihood-free inference with an improved cross-entropy estimator
• Learning to Focus: Cascaded Feature Matching Network for Few-shot Image Recognition
• Voice Conversion with Conditional SampleRNN
• Investigation of Multimodal Features, Classifiers and Fusion Methods for Emotion Recognition
• Multi-Channel Auto-Calibration for the Atmospheric Imaging Assembly using Machine Learning
• StarGAN-VC2: Rethinking Conditional Methods for StarGAN-Based Voice Conversion
• On the Modularity of Hypernetworks
• ByteSing: A Chinese Singing Voice Synthesis System Using Duration Allocated Encoder-Decoder Acoustic Models and WaveRNN Vocoders
• Real-time Sub-milliwatt Epilepsy Detection Implemented on a Spiking Neural Network Edge Inference Processor
• Sliced Recurrent Neural Networks
• Online Self-Supervised Learning for Object Picking: Detecting Optimum Grasping Position using a Metric Learning Approach
• TTS-Portuguese Corpus: a corpus for speech synthesis in Brazilian Portuguese
• Text-Free Prosody-Aware Generative Spoken Language Modeling
• Fitting New Speakers Based on a Short Untranscribed Sample
• Unacceptable, where is my privacy? Exploring Accidental Triggers of Smart Speakers
• Modulated Variational auto-Encoders for many-to-many musical timbre transfer
• EBEN: Extreme bandwidth extension network applied to speech signals captured with noise-resilient body-conduction microphones
• A Tandem Learning Rule for Effective Training and Rapid Inference of Deep Spiking Neural Networks
• Do Neural Nets Learn Statistical Laws behind Natural Language?
• Empirical study on the efficiency of Spiking Neural Networks with axonal delays, and algorithm-hardware benchmarking
• Score and Lyrics-Free Singing Voice Generation
• Advances in Machine and Deep Learning for Modeling and Real-time Detection of Multi-Messenger Sources
• Neural Shuffle-Exchange Networks -- Sequence Processing in O(n log n) Time
• Probability density distillation with generative adversarial networks for high-quality parallel waveform generation
• A Generative Model of Galactic Dust Emission Using Variational Inference
• SylNet: An Adaptable End-to-End Syllable Count Estimator for Speech
• Non-Intrusive Load Monitoring with Fully Convolutional Networks
• Continuous Melody Generation via Disentangled Short-Term Representations and Structural Conditions
• Electra: Conditional Generative Model based Predicate-Aware Query Approximation
• Representation Selective Self-distillation and wav2vec 2.0 Feature Exploration for Spoof-aware Speaker Verification
• Exploring the Landscape of Ubiquitous In-home Health Monitoring: A Comprehensive Survey
• Rethinking Full Connectivity in Recurrent Neural Networks
• Weakly Supervised Temporal Convolutional Networks for Fine-grained Surgical Activity Recognition
• Tensor2Tensor for Neural Machine Translation
• Mel-spectrogram augmentation for sequence to sequence voice conversion
• PixelVAE++: Improved PixelVAE with Discrete Prior
• VSMask: Defending Against Voice Synthesis Attack via Real-Time Predictive Perturbation
• Progressive Tandem Learning for Pattern Recognition with Deep Spiking Neural Networks
• Expressive Speech Synthesis via Modeling Expressions with Variational Autoencoder
• Learning to Remember More with Less Memorization
• Restoring degraded speech via a modified diffusion model
• DrumGAN: Synthesis of Drum Sounds With Timbral Feature Conditioning Using Generative Adversarial Networks
• NAUTILUS: a Versatile Voice Cloning System
• Slip Detection: Analysis and Calibration of Univariate Tactile Signals
• Predicting speech intelligibility from EEG in a non-linear classification paradigm
• Maximizing Mutual Information for Tacotron
• VoiceLoop: Voice Fitting and Synthesis via a Phonological Loop
• Feature reinforcement with word embedding and parsing information in neural TTS
• Machine Speech Chain with One-shot Speaker Adaptation
• Continual Learning in Recurrent Neural Networks
• On the Importance of Attention in Meta-Learning for Few-Shot Text Classification
• Non-Parallel Voice Conversion with Cyclic Variational Autoencoder
• Learning Disentangled Representations for Timber and Pitch in Music Audio
• Generating Black Metal and Math Rock: Beyond Bach, Beethoven, and Beatles
• Because Every Sensor Is Unique, so Is Every Pair: Handling Dynamicity in Traffic Forecasting
• Convolution-enhanced Evolving Attention Networks
• Deep Generative Quantile-Copula Models for Probabilistic Forecasting
• Learning Fast and Slow: PROPEDEUTICA for Real-time Malware Detection
• Learning to Maximize Speech Quality Directly Using MOS Prediction for Neural Text-to-Speech
• Online Phase Reconstruction via DNN-based Phase Differences Estimation
• Blood Vessel Geometry Synthesis using Generative Adversarial Networks
• My(o) Armband Leaks Passwords: An EMG and IMU Based Keylogging Side-Channel Attack
• Temporal Difference Variational Auto-Encoder
• Verification of deep probabilistic models
• Adversarial Generation of Time-Frequency Features with application in audio synthesis
• Online Training of Spiking Recurrent Neural Networks with Phase-Change Memory Synapses
• A Vocoder Based Method For Singing Voice Extraction
• Deep Learning Based Energy Disaggregation and On/Off Detection of Household Appliances
• Emotional Prosody Control for Speech Generation
• VaPar Synth -- A Variational Parametric Model for Audio Synthesis
• Improved Deep Spectral Convolution Network For Hyperspectral Unmixing With Multinomial Mixture Kernel and Endmember Uncertainty
• Cross-speaker Emotion Transfer Based on Speaker Condition Layer Normalization and Semi-Supervised Training in Text-To-Speech
• Semi-Autoregressive Neural Machine Translation
• Sound Event Localization and Detection Using Activity-Coupled Cartesian DOA Vector and RD3net
• ASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech
• End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions
• Training Deep Energy-Based Models with f-Divergence Minimization
• Real-valued parametric conditioning of an RNN for interactive sound synthesis
• Multi-Target Emotional Voice Conversion With Neural Vocoders
• Hard-Coded Gaussian Attention for Neural Machine Translation
• A non-causal FFTNet architecture for speech enhancement
• Autoregressive neural Slater-Jastrow ansatz for variational Monte Carlo simulation
• Autovocoder: Fast Waveform Generation from a Learned Speech Representation using Differentiable Digital Signal Processing
• Adversarial Learning of Deepfakes in Accounting
• Convolutional Normalizing Flows
• NAC-TCN: Temporal Convolutional Networks with Causal Dilated Neighborhood Attention for Emotion Understanding
• Periodic Residual Learning for Crowd Flow Forecasting
• From Artificial Neural Networks to Deep Learning for Music Generation -- History, Concepts and Trends
• Stepwise-Refining Speech Separation Network via Fine-Grained Encoding in High-order Latent Domain
• Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis
• Unconstrained Monotonic Neural Networks
• Phonetic Posteriorgrams based Many-to-Many Singing Voice Conversion via Adversarial Training
• Residual Correction in Real-Time Traffic Forecasting
• Foley Music: Learning to Generate Music from Videos
• Global Guarantees for Blind Demodulation with Generative Priors
• FAIR AI Models in High Energy Physics
• Attention-based Deep Neural Networks for Battery Discharge Capacity Forecasting
• A Hierarchical Recurrent Neural Network for Symbolic Melody Generation
• Fast Transient Stability Prediction Using Grid-informed Temporal and Topological Embedding Deep Neural Network
• Multi-Agent Reinforcement Learning with Multi-Step Generative Models
• Adversarial Attacks and Defenses for Speech Recognition Systems
• Neural Forecasting of the Italian Sovereign Bond Market with Economic News
• Generating Albums with SampleRNN to Imitate Metal, Rock, and Punk Bands
• Source Separation with Deep Generative Priors
• FeatherWave: An efficient high-fidelity neural vocoder with multi-band linear prediction
• End-to-end Networks for Supervised Single-channel Speech Separation
• Meta-Amortized Variational Inference and Learning
• Neural Speech and Audio Coding: Modern AI Technology Meets Traditional Codecs
• ESPnet-ST: All-in-One Speech Translation Toolkit
• Many-to-Many Voice Transformer Network
• Learning Robust Heterogeneous Signal Features from Parallel Neural Network for Audio Sentiment Analysis
• Invariance of Weight Distributions in Rectified MLPs
• CHOPT : Automated Hyperparameter Optimization Framework for Cloud-Based Machine Learning Platforms
• SwishNet: A Fast Convolutional Neural Network for Speech, Music and Noise Classification and Segmentation
• Encoding Musical Style with Transformer Autoencoders
• SVSNet: An End-to-end Speaker Voice Similarity Assessment Model
• Low-rank Characteristic Tensor Density Estimation Part II: Compression and Latent Density Estimation
• WaveTransformer: A Novel Architecture for Audio Captioning Based on Learning Temporal and Time-Frequency Information
• Quasi-Periodic WaveNet Vocoder: A Pitch Dependent Dilated Convolution Model for Parametric Speech Generation
• Zero-Shot Multi-Speaker Text-To-Speech with State-of-the-art Neural Speaker Embeddings
• Recurrent Neural Networks with Stochastic Layers for Acoustic Novelty Detection
• Cycle In Cycle Generative Adversarial Networks for Keypoint-Guided Image Generation
• A Unified Speaker Adaptation Method for Speech Synthesis using Transcribed and Untranscribed Speech with Backpropagation
• Hierarchical VAEs Know What They Don't Know
• Logarithmic Pruning is All You Need
• SNAC: Speaker-normalized affine coupling layer in flow-based architecture for zero-shot multi-speaker text-to-speech
• Modular Meta-Learning with Shrinkage
• Neural Harmonic-plus-Noise Waveform Model with Trainable Maximum Voice Frequency for Text-to-Speech Synthesis
• Pose Guided Fashion Image Synthesis Using Deep Generative Model
• Introducing Model Inversion Attacks on Automatic Speaker Recognition
• SingSong: Generating musical accompaniments from singing
• Neural source-filter waveform models for statistical parametric speech synthesis
• Towards achieving robust universal neural vocoding
• High Quality Facial Surface and Texture Synthesis via Generative Adversarial Networks
• Peptide-Spectra Matching from Weak Supervision
• LARNN: Linear Attention Recurrent Neural Network
• Emotional Video to Audio Transformation Using Deep Recurrent Neural Networks and a Neuro-Fuzzy System
• Image Transformation can make Neural Networks more robust against Adversarial Examples
• Improving Image Classification Robustness through Selective CNN-Filters Fine-Tuning
• Effective parameter estimation methods for an ExcitNet model in generative text-to-speech systems
• Accelerating Minibatch Stochastic Gradient Descent using Typicality Sampling
• Deep Representations for Time-varying Brain Datasets
• GestureGAN for Hand Gesture-to-Gesture Translation in the Wild
• Tools and resources for Romanian text-to-speech and speech-to-text applications
• Dynamically Sampled Nonlocal Gradients for Stronger Adversarial Attacks
• A comparison of recent waveform generation and acoustic modeling methods for neural-network-based speech synthesis
• ContextSpeech: Expressive and Efficient Text-to-Speech for Paragraph Reading
• Monaural source enhancement maximizing source-to-distortion ratio via automatic differentiation
• Textual Echo Cancellation
• Investigation of Using Disentangled and Interpretable Representations for One-shot Cross-lingual Voice Conversion
• Prediction of head motion from speech waveforms with a canonical-correlation-constrained autoencoder
• Robust Sequence-to-Sequence Acoustic Modeling with Stepwise Monotonic Attention for Neural TTS
• Interpretation of Deep Temporal Representations by Selective Visualization of Internally Activated Nodes
• Predictive Sampling with Forecasting Autoregressive Models
• CNN Is All You Need
• Spatio-Temporal Momentum: Jointly Learning Time-Series and Cross-Sectional Strategies
• Voice Cloning: a Multi-Speaker Text-to-Speech Synthesis Approach based on Transfer Learning
• Learning Sparse Wavelet Representations
• Speech Synthesis and Control Using Differentiable DSP
• Fast and Flexible Temporal Point Processes with Triangular Maps
• ConCare: Personalized Clinical Feature Embedding via Capturing the Healthcare Context
• OCTOPUS: Overcoming Performance andPrivatization Bottlenecks in Distributed Learning
• A Vocoder-free WaveNet Voice Conversion with Non-Parallel Data
• Multi-scale aggregation of phase information for reducing computational cost of CNN based DOA estimation
• A Two-part Transformer Network for Controllable Motion Synthesis
• Semi-Recurrent CNN-based VAE-GAN for Sequential Data Generation
• Interactive Text-to-Speech System via Joint Style Analysis
• PortaSpeech: Portable and High-Quality Generative Text-to-Speech
• StarGAN-ZSVC: Towards Zero-Shot Voice Conversion in Low-Resource Contexts
• A New GAN-based End-to-End TTS Training Algorithm
• Parallel Grid Pooling for Data Augmentation
• Detecting Alzheimer's Disease Using Gated Convolutional Neural Network from Audio Data
• Prediction with a Short Memory
• On granularity of prosodic representations in expressive text-to-speech
• Sequential Neural Methods for Likelihood-free Inference
• Effects of Loss Functions And Target Representations on Adversarial Robustness
• Coupled Recurrent Models for Polyphonic Music Composition
• Hierarchically Regularized Deep Forecasting
• SEFGAN: Harvesting the Power of Normalizing Flows and GANs for Efficient High-Quality Speech Enhancement
• Dissecting Contextual Word Embeddings: Architecture and Representation
• MFCCGAN: A Novel MFCC-Based Speech Synthesizer Using Adversarial Learning
• Parallel Synthesis for Autoregressive Speech Generation
• Spiking Neural Predictive Coding for Continual Learning from Data Streams
• Music Artist Classification with Convolutional Recurrent Neural Networks
• Overview of Tasks and Investigation of Subjective Evaluation Methods in Environmental Sound Synthesis and Conversion
• Independent Innovation Analysis for Nonlinear Vector Autoregressive Process
• Super-Resolution Perception for Industrial Sensor Data
• Fine-grained Noise Control for Multispeaker Speech Synthesis
• Towards Rapid and Robust Adversarial Training with One-Step Attacks
• Deep Attention Fusion Feature for Speech Separation with End-to-End Post-filter Method
• Wasserstein-Wasserstein Auto-Encoders
• Improving Sequential Latent Variable Models with Autoregressive Flows
• Incremental Text-to-Speech Synthesis with Prefix-to-Prefix Framework
• SPIN: A High Speed, High Resolution Vision Dataset for Tracking and Action Recognition in Ping Pong
• Self-boosted Time-series Forecasting with Multi-task and Multi-view Learning
• One Deep Music Representation to Rule Them All? : A comparative analysis of different representation learning strategies
• Vector-Quantized Timbre Representation
• A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differences
• Translated Skip Connections -- Expanding the Receptive Fields of Fully Convolutional Neural Networks
• Hierarchical Sequence to Sequence Voice Conversion with Limited Data
• A Brief Overview of Unsupervised Neural Speech Representation Learning
• Non-parallel Voice Conversion System with WaveNet Vocoder and Collapsed Speech Suppression
• Spectrogram Inpainting for Interactive Generation of Instrument Sounds
• A Generalized Framework for Population Based Training
• MaCow: Masked Convolutional Generative Flow
• Dilated Temporal Fully-Convolutional Network for Semantic Segmentation of Motion Capture Data
• Initial investigation of an encoder-decoder end-to-end TTS framework using marginalization of monotonic hard latent alignments
• FlexLip: A Controllable Text-to-Lip System
• The CoRa Tensor Compiler: Compilation for Ragged Tensors with Minimal Padding
• Defending Your Voice: Adversarial Attack on Voice Conversion
• Conversational End-to-End TTS for Voice Agent
• Learning latent representations for style control and transfer in end-to-end speech synthesis
• Cross-Modulation Networks for Few-Shot Learning
• An Exploratory Study on Perceptual Spaces of the Singing Voice
• SeismoGen: Seismic Waveform Synthesis Using Generative Adversarial Networks
• Game-Theoretic Interpretability for Temporal Modeling
• Understanding the Tradeoffs in Client-side Privacy for Downstream Speech Tasks
• Melodic Phrase Segmentation By Deep Neural Networks
• A Simple Convolutional Generative Network for Next Item Recommendation
• DeepWear: Adaptive Local Offloading for On-Wearable Deep Learning
• Multichannel Speech Enhancement by Raw Waveform-mapping using Fully Convolutional Networks
• Speech denoising by parametric resynthesis
• A Novel Speech-Driven Lip-Sync Model with CNN and LSTM
• Learning to Manipulate Object Collections Using Grounded State Representations
• UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generation
• Synthesizing Diverse, High-Quality Audio Textures
• Multi-task WaveNet: A Multi-task Generative Model for Statistical Parametric Speech Synthesis without Fundamental Frequency Conditions
• Equilibrated Recurrent Neural Network: Neuronal Time-Delayed Self-Feedback Improves Accuracy and Stability
• Flow Contrastive Estimation of Energy-Based Models
• AdaCare: Explainable Clinical Health Status Representation Learning via Scale-Adaptive Feature Extraction and Recalibration
• AlignTTS: Efficient Feed-Forward Text-to-Speech System without Explicit Alignment
• LVCNet: Efficient Condition-Dependent Modeling Network for Waveform Generation
• Time Distributed Deep Learning Models for Purely Exogenous Forecasting: Application to Water Table Depth Prediction using Weather Image Time Series
• GraphTCN: Spatio-Temporal Interaction Modeling for Human Trajectory Prediction
• Towards Fine-Grained Prosody Control for Voice Conversion
• NanoFlow: Scalable Normalizing Flows with Sublinear Parameter Complexity
• Physics-inspired spatiotemporal-graph AI ensemble for the detection of higher order wave mode signals of spinning binary black hole mergers
• Universal Approximation of Input-Output Maps by Temporal Convolutional Nets
• Neural Architecture Refinement: A Practical Way for Avoiding Overfitting in NAS
• Collapsed speech segment detection and suppression for WaveNet vocoder
• FastVC: Fast Voice Conversion with non-parallel data
• Energy reconstruction in a liquid argon calorimeter cell using convolutional neural networks
• Diet deep generative audio models with structured lottery
• Neural MOS Prediction for Synthesized Speech Using Multi-Task Learning With Spoofing Detection and Spoofing Type Classification
• Unsupervised Audiovisual Synthesis via Exemplar Autoencoders
• nnAudio: An on-the-fly GPU Audio to Spectrogram Conversion Toolbox Using 1D Convolution Neural Networks
• Feasibility of Modeling Orthogonal Frequency-Division Multiplexing Communication Signals with Unsupervised Generative Adversarial Networks
• Speech Denoising by Accumulating Per-Frequency Modeling Fluctuations
• Coarse-grained spectral projection (CGSP): a deep learning-assisted approach to quantum unitary dynamics
• ASAC: Active Sensing using Actor-Critic models
• Teaching Machines to Code: Neural Markup Generation with Visual Attention
• Seq2Tens: An Efficient Representation of Sequences by Low-Rank Tensor Projections
• A Study of Continuous Vector Representationsfor Theorem Proving
• WaveTTS: Tacotron-based TTS with Joint Time-Frequency Domain Loss
• Neural Drum Machine : An Interactive System for Real-time Synthesis of Drum Sounds
• Dynamic Spatiotemporal Graph Neural Network with Tensor Network
• Personalized Neural Speech Codec
• Conditional Mutual information-based Contrastive Loss for Financial Time Series Forecasting
• Complex Transformer: A Framework for Modeling Complex-Valued Sequence
• Multi-Task Gaussian Processes and Dilated Convolutional Networks for Reconstruction of Reproductive Hormonal Dynamics
• RNNs Evolving on an Equilibrium Manifold: A Panacea for Vanishing and Exploding Gradients?
• Unpaired Image-to-Speech Synthesis with Multimodal Information Bottleneck
• TCN-DPD: Parameter-Efficient Temporal Convolutional Networks for Wideband Digital Predistortion
• Evaluation of self-supervised pre-training for automatic infant movement classification using wearable movement sensors
• A Mathematical Framework for Learning Probability Distributions
• Puffin: pitch-synchronous neural waveform generation for fullband speech on modest devices
• FurcaNeXt: End-to-end monaural speech separation with dynamic gated dilated temporal convolutional networks
• DiffSVC: A Diffusion Probabilistic Model for Singing Voice Conversion
• DP-Parse: Finding Word Boundaries from Raw Speech with an Instance Lexicon
• Pedestrian Detection with Autoregressive Network Phases
• Glow-WaveGAN: Learning Speech Representations from GAN-based Variational Auto-Encoder For High Fidelity Flow-based Speech Synthesis
• UFANS: U-shaped Fully-Parallel Acoustic Neural Structure For Statistical Parametric Speech Synthesis With 20X Faster
• Play as You Like: Timbre-enhanced Multi-modal Music Style Transfer
• TTPP: Temporal Transformer with Progressive Prediction for Efficient Action Anticipation
• Class-Distinct and Class-Mutual Image Generation with GANs
• Mode matching in GANs through latent space learning and inversion
• Investigation of enhanced Tacotron text-to-speech synthesis systems with self-attention for pitch accent language
• Conditional WaveGAN
• Problems using deep generative models for probabilistic audio source separation
• Investigation of learning abilities on linguistic features in sequence-to-sequence text-to-speech synthesis
• Automated Respiratory Event Detection Using Deep Neural Networks
• Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification
• Multi-Task Time Series Forecasting With Shared Attention
• Backpropagation for Implicit Spectral Densities
• Predicting Length of Stay in the Intensive Care Unit with Temporal Pointwise Convolutional Networks
• Can Speaker Augmentation Improve Multi-Speaker End-to-End TTS?
• The global optimum of shallow neural network is attained by ridgelet transform
• UWSpeech: Speech to Speech Translation for Unwritten Languages
• Knowledge-and-Data-Driven Amplitude Spectrum Prediction for Hierarchical Neural Vocoders
• Learning compact generalizable neural representations supporting perceptual grouping
• Alleviating Over-segmentation Errors by Detecting Action Boundaries
• Continuous Graph Flow
• Label-efficient audio classification through multitask learning and self-supervision
• Vision-Infused Deep Audio Inpainting
• On the Discrepancy between Density Estimation and Sequence Generation
• GraphTTS: graph-to-sequence modelling in neural text-to-speech
• Automating Inference of Binary Microlensing Events with Neural Density Estimation
• Polyphone Disambiguation in Mandarin Chinese with Semi-Supervised Learning
• Filtering Variational Objectives
• Rapid Spectral Parameter Prediction for Black Hole X-Ray Binaries using Physicalised Autoencoders
• Context Retrieval via Normalized Contextual Latent Interaction for Conversational Agent
• Nonparallel Voice Conversion with Augmented Classifier Star Generative Adversarial Networks
• Phase-aware music super-resolution using generative adversarial networks
• Sams-Net: A Sliced Attention-based Neural Network for Music Source Separation
• MelGlow: Efficient Waveform Generative Network Based on Location-Variable Convolution
• Black-Box Autoregressive Density Estimation for State-Space Models
• Uncertainty Intervals for Graph-based Spatio-Temporal Traffic Prediction
• I'm Sorry for Your Loss: Spectrally-Based Audio Distances Are Bad at Pitch
• GANs with Conditional Independence Graphs: On Subadditivity of Probability Divergences
• Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structure
• Spatiotemporal Adaptive Neural Network for Long-term Forecasting of Financial Time Series
• Universal Neural Vocoding with Parallel WaveNet
• A Neural Lip-Sync Framework for Synthesizing Photorealistic Virtual News Anchors
• Hyperparameter optimization with REINFORCE and Transformers
• Macedonian Speech Synthesis for Assistive Technology Applications
• Multi-rate attention architecture for fast streamable Text-to-speech spectrum modeling
• The AS-NU System for the M2VoC Challenge
• GenerationMania: Learning to Semantically Choreograph
• NeuralDPS: Neural Deterministic Plus Stochastic Model with Multiband Excitation for Noise-Controllable Waveform Generation
• Neural Networks for Lorenz Map Prediction: A Trip Through Time
• Woodbury Transformations for Deep Generative Flows
• DeepTag: inferring all-cause diagnoses from clinical notes in under-resourced medical domain
• Skeleton-Based Online Action Prediction Using Scale Selection Network
• ATCN: Resource-Efficient Processing of Time Series on Edge
• A study on more realistic room simulation for far-field keyword spotting
• Quasi-Periodic Parallel WaveGAN Vocoder: A Non-autoregressive Pitch-dependent Dilated Convolution Model for Parametric Speech Generation
• Exploiting Syntactic Features in a Parsed Tree to Improve End-to-End TTS
• Deep Context-Aware Novelty Detection
• Estimating Nonlinear Dynamics with the ConvNet Smoother
• Closing the Dequantization Gap: PixelCNN as a Single-Layer Flow
• FastSVC: Fast Cross-Domain Singing Voice Conversion with Feature-wise Linear Modulation
• Speech-Forensics: Towards Comprehensive Synthetic Speech Dataset Establishment and Analysis
• Curriculum Learning for Deep Generative Models with Clustering
• CSLP-AE: A Contrastive Split-Latent Permutation Autoencoder Framework for Zero-Shot Electroencephalography Signal Conversion
• Deep Feed-forward Sequential Memory Networks for Speech Synthesis
• Exploring Context Generalizability in Citywide Crowd Mobility Prediction: An Analytic Framework and Benchmark
• Unsupervised Acoustic Unit Representation Learning for Voice Conversion using WaveNet Auto-encoders
• Shallow Unorganized Neural Networks using Smart Neuron Model for Visual Perception
• LVNS-RAVE: Diversified audio generation with RAVE and Latent Vector Novelty Search
• An algorithmic framework for the optimization of deep neural networks architectures and hyperparameters
• You May Not Need Order in Time Series Forecasting
• Learning to Fuse Music Genres with Generative Adversarial Dual Learning
• Fair Normalizing Flows
• Adversarial Robustness of Flow-Based Generative Models
• Go From the General to the Particular: Multi-Domain Translation with Domain Transformation Networks
• ANIRA: An Architecture for Neural Network Inference in Real-Time Audio Applications
• DarkGAN: Exploiting Knowledge Distillation for Comprehensible Audio Synthesis with GANs
• Fast and High-Quality Singing Voice Synthesis System based on Convolutional Neural Networks
• Likelihood Contribution based Multi-scale Architecture for Generative Flows
• Unified Source-Filter GAN: Unified Source-filter Network Based On Factorization of Quasi-Periodic Parallel WaveGAN
• Low-Latency Speaker-Independent Continuous Speech Separation
• Developing Creative AI to Generate Sculptural Objects
• ExcitNet vocoder: A neural excitation model for parametric speech synthesis systems
• On-device neural speech synthesis
• Unsupervised Style and Content Separation by Minimizing Mutual Information for Speech Synthesis
• Neural source-filter-based waveform model for statistical parametric speech synthesis
• Reducing over-smoothness in speech synthesis using Generative Adversarial Networks
• Short-time deep-learning based source separation for speech enhancement in reverberant environments with beamforming
• Detection of Glottal Closure Instants from Raw Speech using Convolutional Neural Networks
• Classifying Topological Charge in SU(3) Yang-Mills Theory with Machine Learning
• Detection and Evaluation of human and machine generated speech in spoofing attacks on automatic speaker verification systems
• Prosody Learning Mechanism for Speech Synthesis System Without Text Length Limit
• Speech Paralinguistic Approach for Detecting Dementia Using Gated Convolutional Neural Network
• The Tiny Time-series Transformer: Low-latency High-throughput Classification of Astronomical Transients using Deep Model Compression
• Voice command generation using Progressive Wavegans
• Memory and attention in deep learning
• Autoencoding Neural Networks as Musical Audio Synthesizers
• USEV: Universal Speaker Extraction with Visual Cue
• Learning Execution through Neural Code Fusion
• SocialGrid: A TCN-enhanced Method for Online Discussion Forecasting
• Basis-MelGAN: Efficient Neural Vocoder Based on Audio Decomposition
• Exploration of End-to-end Synthesisers forZero Resource Speech Challenge 2020
• Rhythm-Flexible Voice Conversion without Parallel Data Using Cycle-GAN over Phoneme Posteriorgram Sequences
• Adversarial Training of Denoising Diffusion Model Using Dual Discriminators for High-Fidelity Multi-Speaker TTS
• Generic Indic Text-to-speech Synthesisers with Rapid Adaptation in an End-to-end Framework
• Autoregressive Diffusion Models
• Black-Box Inference for Non-Linear Latent Force Models
• Speaker-adaptive neural vocoders for parametric speech synthesis systems
• InverSynth: Deep Estimation of Synthesizer Parameter Configurations from Audio Signals
• Adversarial Learning of Intermediate Acoustic Feature for End-to-End Lightweight Text-to-Speech
• Many-to-Many Voice Conversion using Cycle-Consistent Variational Autoencoder with Multiple Decoders
• FPETS : Fully Parallel End-to-End Text-to-Speech System
• Projected Latent Markov Chain Monte Carlo: Conditional Sampling of Normalizing Flows
• Towards neural reinforcement learning for large deviations in nonequilibrium systems with memory
• Generative Speech Enhancement Based on Cloned Networks
• Wasserstein GAN and Waveform Loss-based Acoustic Model Training for Multi-speaker Text-to-Speech Synthesis Systems Using a WaveNet Vocoder
• Modeling Conceptual Characteristics of Virtual Machines for CPU Utilization Prediction
• Dilated DenseNets for Relational Reasoning
• Triple M: A Practical Text-to-speech Synthesis System With Multi-guidance Attention And Multi-band Multi-time LPCNet
• RawNet: Fast End-to-End Neural Vocoder
• Understanding Patch-Based Learning by Explaining Predictions
• Distribution Preserving Source Separation With Time Frequency Predictive Models
• Multi-Scale Temporal Convolution Network for Classroom Voice Detection
• Learning of Colors from Color Names: Distribution and Point Estimation
• A Dual-Staged Context Aggregation Method Towards Efficient End-To-End Speech Enhancement
• Rhythm-controllable Attention with High Robustness for Long Sentence Speech Synthesis
• ACCO: Automated Causal CNN Scheduling Optimizer for Real-Time Edge Accelerators
• Pretraining Strategies, Waveform Model Choice, and Acoustic Configurations for Multi-Speaker End-to-End Speech Synthesis
• Calibrated Prediction Intervals for Neural Network Regressors
• FeatherTTS: Robust and Efficient attention based Neural TTS
• Learning Individualized Cardiovascular Responses from Large-scale Wearable Sensors Data
• TD3Net: A temporal densely connected multi-dilated convolutional network for lipreading
• AdaVocoder: Adaptive Vocoder for Custom Voice
• Handwriting styles: benchmarks and evaluation metrics
• AI ensemble for signal detection of higher order gravitational wave modes of quasi-circular, spinning, non-precessing binary black hole mergers
• Semi-supervised learning of glottal pulse positions in a neural analysis-synthesis framework
• Harmonic Recomposition using Conditional Autoregressive Modeling
• Revisiting Speech Content Privacy
• Gradient-based Hyperparameter Optimization Over Long Horizons
• Planning in Dynamic Environments with Conditional Autoregressive Models
• Statistical Voice Conversion with Quasi-Periodic WaveNet Vocoder
• Source-Aware Neural Speech Coding for Noisy Speech Compression
• Hallucinating Point Cloud into 3D Sculptural Object
• Scaling up deep neural networks: a capacity allocation perspective
• Generative Adversarial Network based Speaker Adaptation for High Fidelity WaveNet Vocoder
• Weight, Block or Unit? Exploring Sparsity Tradeoffs for Speech Enhancement on Tiny Neural Accelerators
• Relational Data Selection for Data Augmentation of Speaker-dependent Multi-band MelGAN Vocoder
• A study on speech enhancement using exponent-only floating point quantized neural network (EOFP-QNN)
• How Far Are We from Robust Voice Conversion: A Survey
• Improve Cross-lingual Voice Cloning Using Low-quality Code-switched Data
• Audiovisual speaker conversion: jointly and simultaneously transforming facial expression and acoustic characteristics
• In Human Memories. Technology, Creativity and Self-Determination: An Ethical Proposal
• Multi-Frame Cross-Entropy Training for Convolutional Neural Networks in Speech Recognition
• Waveform to Single Sinusoid Regression to Estimate the F0 Contour from Noisy Speech Using Recurrent Deep Neural Networks
• Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification
• Decreasing the size of the Restricted Boltzmann machine
• A Methodology for Exploring Deep Convolutional Features in Relation to Hand-Crafted Features with an Application to Music Audio Modeling
• Automatic Feature Extraction for Heartbeat Anomaly Detection
• Real-time People Tracking and Identification from Sparse mm-Wave Radar Point-clouds
• Learned complex masks for multi-instrument source separation
• DeepA: A Deep Neural Analyzer For Speech And Singing Vocoding
• Frequency domain variants of velvet noise and their application to speech processing and synthesis: with appendices
• Efficient And Scalable Neural Residual Waveform Coding With Collaborative Quantization
• Granular Motor State Monitoring of Free Living Parkinson's Disease Patients via Deep Learning
• Input-independent Attention Weights Are Expressive Enough: A Study of Attention in Self-supervised Audio Transformers
• Learning to Transfer Learn: Reinforcement Learning-Based Selection for Adaptive Transfer Learning
• EMA2S: An End-to-End Multimodal Articulatory-to-Speech System
• MULTIMODAL ANALYSIS: Informed content estimation and audio source separation
• Natural Image Manipulation for Autoregressive Models Using Fisher Scores
• A Fully Time-domain Neural Model for Subband-based Speech Synthesizer
• A Lightweight Music Texture Transfer System
• Under Pressure: Learning to Detect Slip with Barometric Tactile Sensors
• A Cyclical Post-filtering Approach to Mismatch Refinement of Neural Vocoder for Text-to-speech Systems
• Sinusoidal wave generating network based on adversarial learning and its application: synthesizing frog sounds for data augmentation
• Continuous QoE Prediction Based on WaveNet
• A Machine Learning Method for Prediction of Multipath Channels
• Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classification
• Deep Generative Variational Autoencoding for Replay Spoof Detection in Automatic Speaker Verification
• Deep Speech Denoising with Vector Space Projections
• Taco-VC: A Single Speaker Tacotron based Voice Conversion with Limited Data
• Speech Representations and Phoneme Classification for Preserving the Endangered Language of Ladin
• Articulatory-WaveNet: Autoregressive Model For Acoustic-to-Articulatory Inversion
• Neural forecasting at scale
• Reusing Convolutional Activations from Frame to Frame to Speed up Training and Inference
• Modeling of Rakugo Speech and Its Limitations: Toward Speech Synthesis That Entertains Audiences
• Semi-supervised and Population Based Training for Voice Commands Recognition
• Complex-Valued Restricted Boltzmann Machine for Direct Speech Parameterization from Complex Spectra
• Complex Skill Acquisition Through Simple Skill Imitation Learning
• Time-weighted Attentional Session-Aware Recommender System
• Improving the expressiveness of neural vocoding with non-affine Normalizing Flows
• Formal Verification of Long Short-Term Memory based Audio Classifiers: A Star based Approach
• AnyoneNet: Synchronized Speech and Talking Head Generation for Arbitrary Person
• Generalization Challenges for Neural Architectures in Audio Source Separation
• Enhancing audio quality for expressive Neural Text-to-Speech
• Neural text-to-speech with a modeling-by-generation excitation vocoder
• A Neural Network Based Framework for Archetypical Sound Synthesis
• A Transferable Adaptive Domain Adversarial Neural Network for Virtual Reality Augmented EMG-Based Gesture Recognition
• Online Speaker Adaptation for WaveNet-based Neural Vocoders
• Recognition and Synthesis of Object Transport Motion
• Efficient Modelling Across Time of Human Actions and Interactions
• JSSS: free Japanese speech corpus for summarization and simplification
• Self-Attentional Models Application in Task-Oriented Dialogue Generation Systems
• GANtron: Emotional Speech Synthesis with Generative Adversarial Networks
• A Unified Neural Architecture for Instrumental Audio Tasks
• Compact Autoregressive Network
• Modeling Melodic Feature Dependency with Modularized Variational Auto-Encoder
• Effect of choice of probability distribution, randomness, and search methods for alignment modeling in sequence-to-sequence text-to-speech synthesis using hard alignment
• PerformanceNet: Score-to-Audio Music Generation with Multi-Band Convolutional Residual Network
• Analyzing the benefits of communication channels between deep learning models
• A Deep-Bayesian Framework for Adaptive Speech Duration Modification
• Denoising-and-Dereverberation Hierarchical Neural Vocoder for Robust Waveform Generation
• Attentive Sequence to Sequence Translation for Localizing Clips of Interest by Natural Language Descriptions