28 citations · 29 across the 4 of their papers we have counts for
4 papers
It's All in The [MASK]: Simple Instruction-Tuning Enables BERT-like Masked Language Models As Generative Classifiers
Benjamin Clavié, Nathan Cooper, Benjamin Warner
While encoder-only models such as BERT and ModernBERT are ubiquitous in real-world NLP applications, their conventional reliance on task-specific classification heads can limit the…
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
Benjamin Warner, Antoine Chaffin, Benjamin Clavié +11
Encoder-only transformer models such as BERT offer a great performance-size tradeoff for retrieval and classification tasks with respect to larger decoder-only models. Despite bein…
Perplexed: Understanding When Large Language Models are Confused
Nathan Cooper, Torsten Scholak
Large Language Models (LLMs) have become dominant in the Natural Language Processing (NLP) field causing a huge surge in progress in a short amount of time. However, their limitati…
Intelligent Software Tooling for Improving Software Development
Nathan Cooper
Software has eaten the world with many of the necessities and quality of life services people use requiring software. Therefore, tools that improve the software development experie…