2 citations · 2 across the 5 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
Nonparametric Variational Regularisation of Pretrained Transformers
Fabio Fehr, James Henderson
The current paradigm of large-scale pre-training and fine-tuning Transformer large language models has lead to significant improvements across the board in natural language process…
cs.CL2023
Learning to Abstract with Nonparametric Variational Information Bottleneck
Melika Behjati, Fabio Fehr, James Henderson
Learned representations at the level of characters, sub-words, words and sentences, have each contributed to advances in understanding different NLP tasks and linguistic phenomena.…