55 citations · 56 across the 2 of their papers we have counts for
4 papers · 1 filter
Adapters for Enhanced Modeling of Multilingual Knowledge and Text
Yifan Hou, Wenxiang Jiao, Meizhen Liu +3
Large language models appear to learn facts from the large text corpora they are trained on. Such facts are encoded implicitly within their many parameters, making it difficult to…
Towards a Theoretical Understanding of Word and Relation Representation
Carl Allen
Representing words by vectors, or embeddings, enables computational reasoning and is foundational to automating natural language tasks. For example, if word embeddings of similar w…
Analogies Explained: Towards Understanding Word Embeddings
Carl Allen, Timothy Hospedales
Word embeddings generated by neural network methods such as word2vec (W2V) are well known to exhibit seemingly linear behaviour, e.g. the embeddings of analogy "woman is to queen a…
What the Vec? Towards Probabilistically Grounded Embeddings
Carl Allen, Ivana Balažević, Timothy Hospedales
Word2Vec (W2V) and GloVe are popular, fast and efficient word embedding algorithms. Their embeddings are widely used and perform well on a variety of natural language processing ta…