572 citations · 788 across the 31 of their papers we have counts for
3 papers · 1 filter
Parallel Token Prediction for Language Models
Felix Draxler, Justus Will, Farrin Marouf Sofian +3
Autoregressive decoding in language models is inherently slow, generating only one token per forward pass. We propose Parallel Token Prediction (PTP), a general-purpose framework f…
Knowledge Transfer with Medical Language Embeddings
Stephanie L. Hyland, Theofanis Karaletsos, Gunnar Rätsch
Identifying relationships between concepts is a key aspect of scientific knowledge synthesis. Finding these links often requires a researcher to laboriously search through scien- t…
A Generative Model of Words and Relationships from Multiple Sources
Stephanie L. Hyland, Theofanis Karaletsos, Gunnar Rätsch
Neural language models are a powerful tool to embed words into semantic vector spaces. However, learning such models generally relies on the availability of abundant and diverse tr…