Deep Multi-Task Learning with Shared Memory
arXiv:1609.07222
Abstract
Neural network based models have achieved impressive results on various specific tasks. However, in previous works, most models are learned separately based on single-task supervised objectives, which often suffer from insufficient training data. In this paper, we propose two deep architectures which can be trained jointly on multiple related tasks. More specifically, we augment neural model with an external memory, which is shared by several tasks. Experiments on two groups of text classification tasks show that our proposed architectures can improve the performance of a task with the help of other related tasks.
accepted by emnlp2016. arXiv admin note: text overlap with arXiv:1605.05101
References in corpus (7)
- Convolutional Neural Networks for Sentence Classification
- Convolutional Neural Network Architectures for Matching Natural Language Sentences
- A Convolutional Neural Network for Modelling Sentences
- Associative Long Short-Term Memory
- Modelling, Visualising and Summarising Documents with a Single Convolutional Neural Network
- Larger-Context Language Modelling
- Learning Efficient Algorithms with Hierarchical Attentive Memory
Cited by in corpus (8)
- Multi-Task Learning with Deep Neural Networks: A Survey
- Toward Fast and Accurate Neural Chinese Word Segmentation with Multi-Criteria Learning
- Adversarial Multi-Criteria Learning for Chinese Word Segmentation
- Synergistic Learning with Multi-Task DeepONet for Efficient PDE Problem Solving
- Integrating both Visual and Audio Cues for Enhanced Video Caption
- Multi-task Learning for Universal Sentence Embeddings: A Thorough Evaluation using Transfer and Auxiliary Tasks
- Unsupervised Sentiment Analysis by Transferring Multi-source Knowledge
- Multi-Task Neural Processes