Transfer learning from language models to image caption generators: Better models may not transfer better

Marc Tanti, Albert Gatt, Kenneth P. Camilleri

When designing a neural caption generator, a convolutional neural network can be used to extract image features. Is it possible to also use a neural language model to extract sente…