24 citations · 35 across the 11 of their papers we have counts for
3 papers · 1 filter
Learning to Summarize Long Texts with Memory Compression and Transfer
Jaehong Park, Jonathan Pilault, Christopher Pal
We introduce Mem2Mem, a memory-to-memory mechanism for hierarchical recurrent neural network based encoder decoder architectures and we explore its use for abstractive document sum…
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data
Jonathan Pilault, Amine Elhattami, Christopher Pal
Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: ove…
On the impressive performance of randomly weighted encoders in summarization tasks
Jonathan Pilault, Jaehong Park, Christopher Pal
In this work, we investigate the performance of untrained randomly initialized encoders in a general class of sequence to sequence models and compare their performance with that of…