Showing cs.CLShow all
3 papers · 1 filter
cs.CL2022
A Survey on Word Meta-Embedding Learning
Danushka Bollegala, James O'Neill
Meta-embedding (ME) learning is an emerging approach that attempts to learn more accurate word embeddings given existing (source) word embeddings as the sole input. Due to their ab…
cs.CL2018
Analysing Dropout and Compounding Errors in Neural Language Models
James O' Neill, Danushka Bollegala
This paper carries out an empirical analysis of various dropout techniques for language modelling, such as Bernoulli dropout, Gaussian dropout, Curriculum Dropout, Variational Drop…
cs.CL2018
Angular-Based Word Meta-Embedding Learning
James O' Neill, Danushka Bollegala
Ensembling word embeddings to improve distributed word representations has shown good success for natural language processing tasks in recent years. These approaches either carry o…