Convolutional Sequence to Sequence Learning
arXiv:1705.03122
Abstract
The prevalent approach to sequence to sequence learning maps an input sequence to a variable length output sequence via recurrent neural networks. We introduce an architecture based entirely on convolutional neural networks. Compared to recurrent models, computations over all elements can be fully parallelized during training and optimization is easier since the number of non-linearities is fixed and independent of the input length. Our use of gated linear units eases gradient propagation and we equip each decoder layer with a separate attention module. We outperform the accuracy of the deep LSTM setup of Wu et al. (2016) on both WMT'14 English-German and WMT'14 English-French translation at an order of magnitude faster speed, both on GPU and CPU.
References in corpus (15)
- Sequence to Sequence Learning with Neural Networks
- Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
- Deep Residual Learning for Image Recognition
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
- Conditional Image Generation with PixelCNN Decoders
- Pixel Recurrent Neural Networks
- Language Modeling with Gated Convolutional Networks
- Effective Approaches to Attention-based Neural Machine Translation
- Quasi-Recurrent Neural Networks
- A Convolutional Encoder Model for Neural Machine Translation
- Encoding Source Language with Convolutional Neural Network for Machine Translation
- Neural Headline Generation with Sentence-wise Optimization
- Vocabulary Selection Strategies for Neural Machine Translation
- Neural Machine Translation with Recurrent Attention Modeling
- Cutting-off Redundant Repeating Generations for Neural Abstractive Summarization
Cited by in corpus (522)
- BERTScore: Evaluating Text Generation with BERT
- Pre-trained Models for Natural Language Processing: A Survey
- Recent Trends in Deep Learning Based Natural Language Processing
- PACT: Parameterized Clipping Activation for Quantized Neural Networks
- Deep Learning on Traffic Prediction: Methods, Analysis and Future Directions
- FastSpeech: Fast, Robust and Controllable Text to Speech
- Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting
- Non-Autoregressive Neural Machine Translation
- Generating Long Sequences with Sparse Transformers
- Beyond English-Centric Multilingual Machine Translation
- QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
- Leveraging Pre-trained Checkpoints for Sequence Generation Tasks
- Deep Learning Based Text Classification: A Comprehensive Review
- Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders
- VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text
- The Natural Language Decathlon: Multitask Learning as Question Answering
- Improving Graph Neural Network Expressivity via Subgraph Isomorphism Counting
- Hybrid Quantum-Classical Convolutional Neural Networks
- Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges
- Efficiently Trainable Text-to-Speech System Based on Deep Convolutional Networks with Guided Attention
- Spatial-Temporal Transformer Networks for Traffic Flow Forecasting
- Big Bird: Transformers for Longer Sequences
- Non-Local Recurrent Network for Image Restoration
- Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future
- GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
- GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs
- A Survey of Knowledge-Enhanced Text Generation
- Depthwise Separable Convolutions for Neural Machine Translation
- RoFormer: Enhanced Transformer with Rotary Position Embedding
- HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
- Stand-Alone Self-Attention in Vision Models
- Natural Language Processing Advancements By Deep Learning: A Survey
- MASTER: Multi-Aspect Non-local Network for Scene Text Recognition
- A Survey of Domain Adaptation for Neural Machine Translation
- On Extended Long Short-term Memory and Dependent Bidirectional Recurrent Neural Network
- Deformable ConvNets v2: More Deformable, Better Results
- Language Modeling with Deep Transformers
- ST-GRAT: A Novel Spatio-temporal Graph Attention Network for Accurately Forecasting Dynamically Changing Road Speed
- Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning
- An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solution
- Fast Decoding in Sequence Models using Discrete Latent Variables
- Reservoir Computing with Random Skyrmion Textures
- Deep Residual Correction Network for Partial Domain Adaptation
- Graph2Seq: Graph to Sequence Learning with Attention-based Neural Networks
- Non-local Neural Networks
- Weighted Transformer Network for Machine Translation
- ConvBERT: Improving BERT with Span-based Dynamic Convolution
- Perceiver: General Perception with Iterative Attention
- Transforming Question Answering Datasets Into Natural Language Inference Datasets
- STConvS2S: Spatiotemporal Convolutional Sequence to Sequence Network for Weather Forecasting
- Recent Advances in Deep Learning: An Overview
- Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networks
- Privacy-preserving Artificial Intelligence Techniques in Biomedicine
- Scene Text Detection and Recognition: The Deep Learning Era
- Understanding Back-Translation at Scale
- Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning
- Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Study
- Trellis Networks for Sequence Modeling
- Stable Recurrent Models
- LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference
- The Missing Ingredient in Zero-Shot Neural Machine Translation
- A Comparison of Transformer and Recurrent Neural Networks on Multilingual Neural Machine Translation
- It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbations
- Paradigm Shift in Natural Language Processing
- Quasi-hyperbolic momentum and Adam for deep learning
- Controllable Neural Story Plot Generation via Reward Shaping
- Why gradient clipping accelerates training: A theoretical justification for adaptivity
- OpenNMT: Neural Machine Translation Toolkit
- Fully Convolutional Speech Recognition
- Deep Learning Inference in Facebook Data Centers: Characterization, Performance Optimizations and Hardware Implications
- Bi-Directional Block Self-Attention for Fast and Memory-Efficient Sequence Modeling
- Taskmaster-1: Toward a Realistic and Diverse Dialog Dataset
- On Self Modulation for Generative Adversarial Networks
- A Survey of Automatic Generation of Source Code Comments: Algorithms and Techniques
- Very Deep Transformers for Neural Machine Translation
- Graph Neural Networks for Natural Language Processing: A Survey
- NSML: A Machine Learning Platform That Enables You to Focus on Your Models
- DeepTrack: Lightweight Deep Learning for Vehicle Path Prediction in Highways
- CNN+CNN: Convolutional Decoders for Image Captioning
- Spatial Broadcast Decoder: A Simple Architecture for Learning Disentangled Representations in VAEs
- Neural Abstractive Text Summarization with Sequence-to-Sequence Models
- The Sockeye 2 Neural Machine Translation Toolkit at AMTA 2020
- Relation Networks for Object Detection
- Transformer-Transducer: End-to-End Speech Recognition with Self-Attention
- Non-Autoregressive Machine Translation with Disentangled Context Transformer
- Encoding word order in complex embeddings
- ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech
- Unsupervised Time Series Outlier Detection with Diversity-Driven Convolutional Ensembles -- Extended Version
- Integrating Frequency Translational Invariance in TDNNs and Frequency Positional Information in 2D ResNets to Enhance Speaker Verification
- Abstractive Summarization of Reddit Posts with Multi-level Memory Networks
- Pyramid Feature Attention Network for Saliency detection
- Pervasive Attention: 2D Convolutional Neural Networks for Sequence-to-Sequence Prediction
- Topic-Guided Variational Autoencoders for Text Generation
- Towards Accurate Scene Text Recognition with Semantic Reasoning Networks
- Txt2Img-MHN: Remote Sensing Image Generation from Text Using Modern Hopfield Networks
- Reading Scene Text with Attention Convolutional Sequence Modeling
- Analyzing Uncertainty in Neural Machine Translation
- Next Item Recommendation with Self-Attention
- Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction
- Deep Learning for Plasma Tomography and Disruption Prediction from Bolometer Data
- Revisiting the Effectiveness of Off-the-shelf Temporal Modeling Approaches for Large-scale Video Classification
- Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learning
- Guided Generation of Cause and Effect
- Forecast Network-Wide Traffic States for Multiple Steps Ahead: A Deep Learning Approach Considering Dynamic Non-Local Spatial Correlation and Non-Stationary Temporal Dependency
- Text Compression-aided Transformer Encoding
- Time2Vec: Learning a Vector Representation of Time
- Emergent Translation in Multi-Agent Communication
- Universal Neural Machine Translation for Extremely Low Resource Languages
- DeLighT: Deep and Light-weight Transformer
- Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes
- 6GCVAE: Gated Convolutional Variational Autoencoder for IPv6 Target Generation
- Joint Embedding of Words and Labels for Text Classification
- TNCR: Table Net Detection and Classification Dataset
- Data Diversification: A Simple Strategy For Neural Machine Translation
- Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognition
- Mixed-Precision Training for NLP and Speech Recognition with OpenSeq2Seq
- Minimizing the Bag-of-Ngrams Difference for Non-Autoregressive Neural Machine Translation
- Dynamic Self-Attention : Computing Attention over Words Dynamically for Sentence Embedding
- Towards Binary-Valued Gates for Robust LSTM Training
- TLSAN: Time-aware Long- and Short-term Attention Network for Next-item Recommendation
- Unifying Human and Statistical Evaluation for Natural Language Generation
- Few-shot Autoregressive Density Estimation: Towards Learning to Learn Distributions
- Deep Learning Based Chatbot Models
- A Focus on Neural Machine Translation for African Languages
- Comparative evaluation of CNN architectures for Image Caption Generation
- Abstractive and Extractive Text Summarization using Document Context Vector and Recurrent Neural Networks
- Multilingual NMT with a language-independent attention bridge
- Letter-Based Speech Recognition with Gated ConvNets
- Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization
- Energy-Based Reranking: Improving Neural Machine Translation Using Energy-Based Models
- MetaMT,a MetaLearning Method Leveraging Multiple Domain Data for Low Resource Machine Translation
- Are Pre-trained Convolutions Better than Pre-trained Transformers?
- End-to-End Adversarial Text-to-Speech
- Understanding Knowledge Distillation in Non-autoregressive Machine Translation
- Improving Neural Machine Translation Robustness via Data Augmentation: Beyond Back Translation
- Character-Based Handwritten Text Transcription with Attention Networks
- Data-driven Summarization of Scientific Articles
- Convolutional Sequence to Sequence Model for Human Dynamics
- Identifying and Controlling Important Neurons in Neural Machine Translation
- Pedestrian Attribute Recognition: A Survey
- Relation Distillation Networks for Video Object Detection
- DivGraphPointer: A Graph Pointer Network for Extracting Diverse Keyphrases
- Meta-Learning for Low-Resource Neural Machine Translation
- Who Needs Words? Lexicon-Free Speech Recognition
- Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models
- Describe and Attend to Track: Learning Natural Language guided Structural Representation and Visual Attention for Object Tracking
- Towards a Robust Deep Neural Network in Texts: A Survey
- Reinforced Self-Attention Network: a Hybrid of Hard and Soft Attention for Sequence Modeling
- scb-mt-en-th-2020: A Large English-Thai Parallel Corpus
- A Reinforced Topic-Aware Convolutional Sequence-to-Sequence Model for Abstractive Text Summarization
- Controllable Abstractive Summarization
- An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learning
- Learning to Segment Inputs for NMT Favors Character-Level Processing
- Boosting Neural Machine Translation
- Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data
- ProGraML: Graph-based Deep Learning for Program Optimization and Analysis
- Exploiting Deep Representations for Neural Machine Translation
- A Comprehensive Survey of Grammar Error Correction
- On Extractive and Abstractive Neural Document Summarization with Transformer Language Models
- Parallelizing Linear Recurrent Neural Nets Over Sequence Length
- Dual-mode ASR: Unify and Improve Streaming ASR with Full-context Modeling
- A Survey of Knowledge Enhanced Pre-trained Models
- Neural Language Generation: Formulation, Methods, and Evaluation
- Context in Neural Machine Translation: A Review of Models and Evaluations
- A neural interlingua for multilingual machine translation
- DL2: A Deep Learning-driven Scheduler for Deep Learning Clusters
- A Targeted Attack on Black-Box Neural Machine Translation with Parallel Data Poisoning
- On the adequacy of untuned warmup for adaptive optimization
- Multi-Head Attention with Disagreement Regularization
- Transformer Hawkes Process
- You May Not Need Attention
- Neutron: An Implementation of the Transformer Translation Model and its Variants
- Embedding API Dependency Graph for Neural Code Generation
- STG2Seq: Spatial-temporal Graph to Sequence Model for Multi-step Passenger Demand Forecasting
- Trajectory Space Factorization for Deep Video-Based 3D Human Pose Estimation
- Collaborative Video Object Segmentation by Foreground-Background Integration
- BioNetExplorer: Architecture-Space Exploration of Bio-Signal Processing Deep Neural Networks for Wearables
- An Exploration of Word Embedding Initialization in Deep-Learning Tasks
- Emotion-Aware Transformer Encoder for Empathetic Dialogue Generation
- Distilling Knowledge Learned in BERT for Text Generation
- Review of end-to-end speech synthesis technology based on deep learning
- TreeBERT: A Tree-Based Pre-Trained Model for Programming Language
- ConvS2S-VC: Fully convolutional sequence-to-sequence voice conversion
- Exploration of Neural Machine Translation in Autoformalization of Mathematics in Mizar
- Highrisk Prediction from Electronic Medical Records via Deep Attention Networks
- Low Resource Neural Machine Translation: A Benchmark for Five African Languages
- Using deep Residual Networks to search for galaxy-Lyα emitter lens candidates based on spectroscopic-selection
- Detecting Hallucinated Content in Conditional Neural Sequence Generation
- SCAN: Sliding Convolutional Attention Network for Scene Text Recognition
- Multi-granularity Generator for Temporal Action Proposal
- Adaptively Sparse Transformers
- Towards Robust Neural Machine Translation
- Convolutional Self-Attention Networks
- Learning to Exploit Invariances in Clinical Time-Series Data using Sequence Transformer Networks
- Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddings
- Self-Attentive Residual Decoder for Neural Machine Translation
- Mixed Precision Low-bit Quantization of Neural Network Language Models for Speech Recognition
- Dynamic Fusion with Intra- and Inter- Modality Attention Flow for Visual Question Answering
- Audiovisual Transformer Architectures for Large-Scale Classification and Synchronization of Weakly Labeled Audio Events
- A Study of Reinforcement Learning for Neural Machine Translation
- Knowing What, Where and When to Look: Efficient Video Action Modeling with Attention
- Towards Neural Machine Translation for African Languages
- A Survey on Document-level Neural Machine Translation: Methods and Evaluation
- Non-Autoregressive Neural Machine Translation with Enhanced Decoder Input
- Time-aware Large Kernel Convolutions
- Have convolutions already made recurrence obsolete for unconstrained handwritten text recognition ?
- Attention Aided CSI Wireless Localization
- Context-Aware Learning for Neural Machine Translation
- Sliced Recurrent Neural Networks
- ConvNets and ImageNet Beyond Accuracy: Understanding Mistakes and Uncovering Biases
- Compositionality decomposed: how do neural networks generalise?
- Training Deeper Neural Machine Translation Models with Transparent Attention
- Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialog
- Neural Shuffle-Exchange Networks -- Sequence Processing in O(n log n) Time
- Pop Music Highlighter: Marking the Emotion Keypoints
- Neural Machine Translation with Noisy Lexical Constraints
- Learning to recognize touch gestures: recurrent vs. convolutional features and dynamic sampling
- A Universal Parent Model for Low-Resource Neural Machine Translation Transfer
- What they do when in doubt: a study of inductive biases in seq2seq learners
- Tensor2Tensor for Neural Machine Translation
- Unsupervised Neural Machine Translation with Weight Sharing
- Deconvolution-Based Global Decoding for Neural Machine Translation
- Unsupervised Multi-modal Neural Machine Translation
- Breaking the Beam Search Curse: A Study of (Re-)Scoring Methods and Stopping Criteria for Neural Machine Translation
- Relative Positional Encoding for Transformers with Linear Complexity
- Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion
- Multimodal Image Captioning for Marketing Analysis
- Boosting Objective Scores of a Speech Enhancement Model by MetricGAN Post-processing
- Information Aggregation for Multi-Head Attention with Routing-by-Agreement
- Taming Pretrained Transformers for Extreme Multi-label Text Classification
- Denoising Neural Machine Translation Training with Trusted Data and Online Data Selection
- Gaussian Quadrature for Kernel Features
- PharmMT: A Neural Machine Translation Approach to Simplify Prescription Directions
- Temporal Deformable Convolutional Encoder-Decoder Networks for Video Captioning
- Hybrid Self-Attention Network for Machine Translation
- Visual Text Correction
- Fast, Diverse and Accurate Image Captioning Guided By Part-of-Speech
- Latent-Variable Non-Autoregressive Neural Machine Translation with Deterministic Inference Using a Delta Posterior
- Context- and Sequence-Aware Convolutional Recurrent Encoder for Neural Machine Translation
- Source-side Prediction for Neural Headline Generation
- A Comprehensive Survey of Deep Learning for Image Captioning
- The Importance of Being Recurrent for Modeling Hierarchical Structure
- Improving Neural Machine Translation with Conditional Sequence Generative Adversarial Nets
- Multilingual Neural Machine Translation with Language Clustering
- Improve Transformer Models with Better Relative Position Embeddings
- Neural Classification of Malicious Scripts: A study with JavaScript and VBScript
- An Encoder-Decoder Framework Translating Natural Language to Database Queries
- Incremental Adaptation of NMT for Professional Post-editors: A User Study
- Deep Neural Machine Translation with Weakly-Recurrent Units
- Stochastic Optimization with Heavy-Tailed Noise via Accelerated Gradient Clipping
- Assessment Modeling: Fundamental Pre-training Tasks for Interactive Educational Systems
- Positively Scale-Invariant Flatness of ReLU Neural Networks
- Abstractive Summarization Using Attentive Neural Techniques
- In Conclusion Not Repetition: Comprehensive Abstractive Summarization With Diversified Attention Based On Determinantal Point Processes
- Semi-Autoregressive Neural Machine Translation
- SING: Symbol-to-Instrument Neural Generator
- Hint-Based Training for Non-Autoregressive Machine Translation
- Towards Understanding Neural Machine Translation with Word Importance
- ZerO Initialization: Initializing Neural Networks with only Zeros and Ones
- Transformer Based Reinforcement Learning For Games
- ENCORE: Ensemble Learning using Convolution Neural Machine Translation for Automatic Program Repair
- Comprehensible Context-driven Text Game Playing
- PVRED: A Position-Velocity Recurrent Encoder-Decoder for Human Motion Prediction
- LAVA NAT: A Non-Autoregressive Translation Model with Look-Around Decoding and Vocabulary Attention
- A Baseline Neural Machine Translation System for Indian Languages
- GRN: Gated Relation Network to Enhance Convolutional Neural Network for Named Entity Recognition
- Defending Against Backdoor Attacks in Natural Language Generation
- A Gap-Based Framework for Chinese Word Segmentation via Very Deep Convolutional Networks
- Dual-Awareness Attention for Few-Shot Object Detection
- Kalman Filtering Attention for User Behavior Modeling in CTR Prediction
- Many-to-Many Voice Transformer Network
- Dynamic Past and Future for Neural Machine Translation
- Hierarchical Pooling Structure for Weakly Labeled Sound Event Detection
- Neural Phrase-to-Phrase Machine Translation
- Automated Classification of Sleep Stages and EEG Artifacts in Mice with Deep Learning
- Double Path Networks for Sequence to Sequence Learning
- Bag-of-Words as Target for Neural Machine Translation
- Regularizing Neural Machine Translation by Target-bidirectional Agreement
- Lightweight Convolutional Representations for On-Device Natural Language Processing
- Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration
- A Study of Multilingual Neural Machine Translation
- Fine-Tuning by Curriculum Learning for Non-Autoregressive Neural Machine Translation
- Gated Hierarchical Attention for Image Captioning
- Neural Machine Translation: A Review of Methods, Resources, and Tools
- Improving Domain Adaptation Translation with Domain Invariant and Specific Information
- Hard but Robust, Easy but Sensitive: How Encoder and Decoder Perform in Neural Machine Translation
- Regularizing activations in neural networks via distribution matching with the Wasserstein metric
- Machine Translation : From Statistical to modern Deep-learning practices
- Neural Chinese Word Segmentation as Sequence to Sequence Translation
- Better Sign Language Translation with STMC-Transformer
- Convolutional Neural Network for Trajectory Prediction
- Filtering and Mining Parallel Data in a Joint Multilingual Space
- QuickEdit: Editing Text & Translations by Crossing Words Out
- LAMBERT: Layout-Aware (Language) Modeling for information extraction
- Multiscale Collaborative Deep Models for Neural Machine Translation
- Recurrent Graph Syntax Encoder for Neural Machine Translation
- Improving Conditional Sequence Generative Adversarial Networks by Stepwise Evaluation
- Neural Machine Translation with Adequacy-Oriented Learning
- Constrained Decoding for Neural NLG from Compositional Representations in Task-Oriented Dialogue
- Multi-Domain Adaptation in Neural Machine Translation Through Multidimensional Tagging
- Gated Channel Transformation for Visual Recognition
- Learning Probabilistic Coordinate Fields for Robust Correspondences
- Reflective Decoding Network for Image Captioning
- A General-Purpose Tagger with Convolutional Neural Networks
- SocialInteractionGAN: Multi-person Interaction Sequence Generation
- Zero-Resource Neural Machine Translation with Multi-Agent Communication Game
- Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
- Tag-less Back-Translation
- Refining Source Representations with Relation Networks for Neural Machine Translation
- Optimizing Prediction Serving on Low-Latency Serverless Dataflow
- Incorporating Word and Subword Units in Unsupervised Machine Translation Using Language Model Rescoring
- PIC: Permutation Invariant Convolution for Recognizing Long-range Activities
- Future Data Helps Training: Modeling Future Contexts for Session-based Recommendation
- Alleviating the Inequality of Attention Heads for Neural Machine Translation
- Integrative Analysis of Patient Health Records and Neuroimages via Memory-based Graph Convolutional Network
- Greedy Search with Probabilistic N-gram Matching for Neural Machine Translation
- Deep Extreme Multi-label Learning
- Controlled CNN-based Sequence Labeling for Aspect Extraction
- Dissecting Contextual Word Embeddings: Architecture and Representation
- Would You Ask it that Way? Measuring and Improving Question Naturalness for Knowledge Graph Question Answering
- SelfSeg: A Self-supervised Sub-word Segmentation Method for Neural Machine Translation
- Capacity Control of ReLU Neural Networks by Basis-path Norm
- Reference Language based Unsupervised Neural Machine Translation
- A Holistic Representation Guided Attention Network for Scene Text Recognition
- Contextual Lensing of Universal Sentence Representations
- Cell-aware Stacked LSTMs for Modeling Sentences
- Optimal Completion Distillation for Sequence Learning
- Denoising based Sequence-to-Sequence Pre-training for Text Generation
- Pairwise Interactive Graph Attention Network for Context-Aware Recommendation
- A Stable and Effective Learning Strategy for Trainable Greedy Decoding
- Fill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation
- Improving Attention Mechanism with Query-Value Interaction
- Tensor Networks for Probabilistic Sequence Modeling
- Robust Neural Malware Detection Models for Emulation Sequence Learning
- Knowledge-Grounded Dialogue Generation with Pre-trained Language Models
- Tensorized Self-Attention: Efficiently Modeling Pairwise and Global Dependencies Together
- Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention
- Robust Neural Machine Translation with Joint Textual and Phonetic Embedding
- With Little Power Comes Great Responsibility
- GraphTCN: Spatio-Temporal Interaction Modeling for Human Trajectory Prediction
- Refining Source Representations with Relation Networks for Neural Machine Translation
- A Neural Virtual Anchor Synthesizer based on Seq2Seq and GAN Models
- Joint Detection of Malicious Domains and Infected Clients
- Multiresolution Transformer Networks: Recurrence is Not Essential for Modeling Hierarchical Structure
- Transformer-based Arabic Dialect Identification
- Dense Information Flow for Neural Machine Translation
- Curb Your Carbon Emissions: Benchmarking Carbon Emissions in Machine Translation
- Universal Approximation of Input-Output Maps by Temporal Convolutional Nets
- On-the-Fly Syntax Highlighting using Neural Networks
- A Brief Survey of Multilingual Neural Machine Translation
- Neural Architecture Refinement: A Practical Way for Avoiding Overfitting in NAS
- CMFN: Cross-Modal Fusion Network for Irregular Scene Text Recognition
- Learning Context-Sensitive Convolutional Filters for Text Processing
- Time Distributed Deep Learning Models for Purely Exogenous Forecasting: Application to Water Table Depth Prediction using Weather Image Time Series
- A Simple Convolutional Generative Network for Next Item Recommendation
- Applying SVGD to Bayesian Neural Networks for Cyclical Time-Series Prediction and Inference
- Fast Prototyping a Dialogue Comprehension System for Nurse-Patient Conversations on Symptom Monitoring
- Deep Probabilistic Time Series Forecasting using Augmented Recurrent Input for Dynamic Systems
- Learning to Discriminate Noises for Incorporating External Information in Neural Machine Translation
- Table-to-Text Generation with Effective Hierarchical Encoder on Three Dimensions (Row, Column and Time)
- Bayesian Transformer Language Models for Speech Recognition
- Multi-Task Gaussian Processes and Dilated Convolutional Networks for Reconstruction of Reproductive Hormonal Dynamics
- RNNs Evolving on an Equilibrium Manifold: A Panacea for Vanishing and Exploding Gradients?
- Efficient Bidirectional Neural Machine Translation
- The TALP-UPC System for the WMT Similar Language Task: Statistical vs Neural Machine Translation
- Cross-lingual Supervision Improves Unsupervised Neural Machine Translation
- Token-level Adaptive Training for Neural Machine Translation
- What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding
- DTMT: A Novel Deep Transition Architecture for Neural Machine Translation
- COSEA: Convolutional Code Search with Layer-wise Attention
- End-to-End Non-Autoregressive Neural Machine Translation with Connectionist Temporal Classification
- Polyphone Disambiguation in Mandarin Chinese with Semi-Supervised Learning
- Classifying Long Clinical Documents with Pre-trained Transformers
- On the Privacy Risks of Deploying Recurrent Neural Networks in Machine Learning Models
- Character-Aware Decoder for Translation into Morphologically Rich Languages
- Fast and Simple Mixture of Softmaxes with BPE and Hybrid-LightRNN for Language Generation
- Convolutional Neural Networks with Recurrent Neural Filters
- TYolov5: A Temporal Yolov5 Detector Based on Quasi-Recurrent Neural Networks for Real-Time Handgun Detection in Video
- Title-Guided Encoding for Keyphrase Generation
- Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification
- Knowledge Graph Question Answering via SPARQL Silhouette Generation
- Infusing Sequential Information into Conditional Masked Translation Model with Self-Review Mechanism
- Goal-driven Command Recommendations for Analysts
- A Stochastic Decoder for Neural Machine Translation
- Correct Me If You Can: Learning from Error Corrections and Markings
- Dynamic Sentence Sampling for Efficient Training of Neural Machine Translation
- Task-Level Curriculum Learning for Non-Autoregressive Neural Machine Translation
- Stock2Vec: A Hybrid Deep Learning Framework for Stock Market Prediction with Representation Learning and Temporal Convolutional Network
- Sparse Lifting of Dense Vectors: Unifying Word and Sentence Representations
- Improving Bidirectional Decoding with Dynamic Target Semantics in Neural Machine Translation
- Is Attention All What You Need? -- An Empirical Investigation on Convolution-Based Active Memory and Self-Attention
- Attention Focusing for Neural Machine Translation by Bridging Source and Target Embeddings
- Relation Extraction using Explicit Context Conditioning
- Attentive Convolution: Equipping CNNs with RNN-style Attention Mechanisms
- Lexicon-constrained Copying Network for Chinese Abstractive Summarization
- Meta-Embeddings Based On Self-Attention
- Low Rank Factorization for Compact Multi-Head Self-Attention
- Adversarial Subword Regularization for Robust Neural Machine Translation
- Probing Word Translations in the Transformer and Trading Decoder for Encoder Layers
- SoPa: Bridging CNNs, RNNs, and Weighted Finite-State Machines
- MUFold-BetaTurn: A Deep Dense Inception Network for Protein Beta-Turn Prediction
- Structure-Invariant Testing for Machine Translation
- Initialization and Regularization of Factorized Neural Layers
- Listen, Attend, Spell and Adapt: Speaker Adapted Sequence-to-Sequence ASR
- Sequence-Level Knowledge Distillation for Model Compression of Attention-based Sequence-to-Sequence Speech Recognition
- Multi-Reference Training with Pseudo-References for Neural Translation and Text Generation
- Simplifying Neural Machine Translation with Addition-Subtraction Twin-Gated Recurrent Networks
- Hyperbolic Neural Networks++
- Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis
- Neural Machine Translation: A Review and Survey
- Learning Contextualized Sentence Representations for Document-Level Neural Machine Translation
- ATCN: Resource-Efficient Processing of Time Series on Edge
- Analyzing and Interpreting Convolutional Neural Networks in NLP
- Controllable Dual Skew Divergence Loss for Neural Machine Translation
- Once a MAN: Towards Multi-Target Attack via Learning Multi-Target Adversarial Network Once
- Recommending Multiple Positive Citations for Manuscript via Content-Dependent Modeling and Multi-Positive Triplet
- Neural Networks for Predicting Human Interactions in Repeated Games
- Enhanced Neural Machine Translation by Learning from Draft
- Normalization Before Shaking Toward Learning Symmetrically Distributed Representation Without Margin in Speech Emotion Recognition
- Improving Irregularly Sampled Time Series Learning with Dense Descriptors of Time
- Shallow-to-Deep Training for Neural Machine Translation
- Learning the Dynamics of Sparsely Observed Interacting Systems
- STS Classification with Dual-stream CNN
- Multiplicative Position-aware Transformer Models for Language Understanding
- A Semi-Supervised Approach for Abnormal Event Prediction on Large Operational Network Time-Series Data
- Language-Independent Representor for Neural Machine Translation
- TE-ESN: Time Encoding Echo State Network for Prediction Based on Irregularly Sampled Time Series Data
- Machine Translation between Vietnamese and English: an Empirical Study
- Image Captioning as Neural Machine Translation Task in SOCKEYE
- A Domain Generalization Perspective on Listwise Context Modeling
- Mixture of Expert/Imitator Networks: Scalable Semi-supervised Learning Framework
- A Novel Integrated Framework for Learning both Text Detection and Recognition
- Source Dependency-Aware Transformer with Supervised Self-Attention
- Review-Driven Answer Generation for Product-Related Questions in E-Commerce
- Transformer-based Automatic Post-Editing with a Context-Aware Encoding Approach for Multi-Source Inputs
- Detecting and Understanding Generalization Barriers for Neural Machine Translation
- Iterative Batch Back-Translation for Neural Machine Translation: A Conceptual Model
- Open-Ended Long-Form Video Question Answering via Hierarchical Convolutional Self-Attention Networks
- Investigating Label Bias in Beam Search for Open-ended Text Generation
- Graph Neural Networks for Node-Level Predictions
- Sequence Generation: From Both Sides to the Middle
- An Investigation of Warning Erroneous Chat Translations in Cross-lingual Communication
- Analyzing Architectures for Neural Machine Translation Using Low Computational Resources
- Graph-to-Sequence Neural Machine Translation
- An Interactive Machine Translation Framework for Modernizing Historical Documents
- A Hierarchical Neural Network for Sequence-to-Sequences Learning
- Shaking Acoustic Spectral Sub-bands Can Better Regularize Learning in Affective Computing
- Rational Recurrences
- Lipschitz Constrained Parameter Initialization for Deep Transformers
- Gradients are Not All You Need
- Generating Diverse Translation by Manipulating Multi-Head Attention
- Characters Detection on Namecard with faster RCNN
- GWLAN: General Word-Level AutocompletioN for Computer-Aided Translation
- Context-Gated Convolution
- Efficiently Reusing Old Models Across Languages via Transfer Learning
- FPETS : Fully Parallel End-to-End Text-to-Speech System
- Cut-Based Graph Learning Networks to Discover Compositional Structure of Sequential Video Data
- Domain Decluttering: Simplifying Images to Mitigate Synthetic-Real Domain Shift and Improve Depth Estimation
- A Daily Tourism Demand Prediction Framework Based on Multi-head Attention CNN: The Case of The Foreign Entrant in South Korea
- Converse Attention Knowledge Transfer for Low-Resource Named Entity Recognition
- Dispatcher: A Message-Passing Approach To Language Modelling
- Is High Variance Unavoidable in RL? A Case Study in Continuous Control
- Cross Copy Network for Dialogue Generation
- Summarizing Videos with Attention
- Speeding Up Neural Machine Translation Decoding by Cube Pruning
- Logographic Subword Model for Neural Machine Translation
- Multi-Glimpse Network: A Robust and Efficient Classification Architecture based on Recurrent Downsampled Attention
- META: Memory-efficient taxonomic classification and abundance estimation for metagenomics with deep learning
- A Large-Scale Multi-Length Headline Corpus for Analyzing Length-Constrained Headline Generation Model Evaluation
- Beyond Weight Tying: Learning Joint Input-Output Embeddings for Neural Machine Translation
- CASA-NLU: Context-Aware Self-Attentive Natural Language Understanding for Task-Oriented Chatbots
- Attentive Sequence to Sequence Translation for Localizing Clips of Interest by Natural Language Descriptions
- Recognizing Arrow Of Time In The Short Stories
- Exploration into Translation-Equivariant Image Quantization
- Learning Hard Retrieval Decoder Attention for Transformers
- Using holistic event information in the trigger
- Efficient Purely Convolutional Text Encoding
- Sequential Recommender via Time-aware Attentive Memory Network
- Semi-Supervised Few-Shot Learning for Dual Question-Answer Extraction
- An In-depth Walkthrough on Evolution of Neural Machine Translation
- SongNet: Rigid Formats Controlled Text Generation
- Testing Machine Translation via Referential Transparency
- Highway Transformer: Self-Gating Enhanced Self-Attentive Networks
- All Word Embeddings from One Embedding
- DyDiff-VAE: A Dynamic Variational Framework for Information Diffusion Prediction
- A Deep-Bayesian Framework for Adaptive Speech Duration Modification
- Single-Queue Decoding for Neural Machine Translation
- MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive Machine Translation
- Sentence Structure and Word Relationship Modeling for Emphasis Selection
- Reducing the impact of out of vocabulary words in the translation of natural language questions into SPARQL queries
- Distributionally Robust Language Modeling
- Similarity Classification of Public Transit Stations
- Learning a binary search with a recurrent neural network. A novel approach to ordinal regression analysis
- A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis
- Transformer-based Methods for Recognizing Ultra Fine-grained Entities (RUFES)
- Representing Unordered Data Using Complex-Weighted Multiset Automata
- Revisit Systematic Generalization via Meaningful Learning
- Neural Machine Translation for Multilingual Grapheme-to-Phoneme Conversion
- Regularized Context Gates on Transformer for Machine Translation
- Densely Connected Graph Convolutional Networks for Graph-to-Sequence Learning
- Self-Attentional Models Application in Task-Oriented Dialogue Generation Systems
- UdS Submission for the WMT 19 Automatic Post-Editing Task
- An Augmented Transformer Architecture for Natural Language Generation Tasks
- Self-attention based end-to-end Hindi-English Neural Machine Translation
- Reference Network for Neural Machine Translation
- Latent Part-of-Speech Sequences for Neural Machine Translation
- Improving Multi-Head Attention with Capsule Networks
- Temporally Folded Convolutional Neural Networks for Sequence Forecasting
- A Discriminative Neural Model for Cross-Lingual Word Alignment
- GRET: Global Representation Enhanced Transformer
- One Model to Learn Both: Zero Pronoun Prediction and Translation
- To Understand Representation of Layer-aware Sequence Encoders as Multi-order-graph
- Sentence-wise Smooth Regularization for Sequence to Sequence Learning
- GPNAS: A Neural Network Architecture Search Framework Based on Graphical Predictor
- Token Drop mechanism for Neural Machine Translation
- Automatic Post-Editing for Vietnamese
- Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
- ARCH: Efficient Adversarial Regularized Training with Caching
- REAM: An Enhancement Approach to Reference-based Evaluation Metrics for Open-domain Dialog Generation
- Global Structure-Aware Drum Transcription Based on Self-Attention Mechanisms
- Otem&Utem: Over- and Under-Translation Evaluation Metric for NMT
- Sequence-to-Sequence Learning with Latent Neural Grammars