4 papers · 1 filter
Alternatives To Next Token Prediction In Text Generation -- A Survey
Charlie Wyatt, Aditya Joshi, Flora Salim
The paradigm of Next Token Prediction (NTP) has driven the unprecedented success of Large Language Models (LLMs), but is also the source of their most persistent weaknesses such as…
What am I missing here?: Evaluating Large Language Models for Masked Sentence Prediction
Charlie Wyatt, Aditya Joshi, Flora Salim
Transformer-based models primarily rely on Next Token Prediction (NTP), which predicts the next token in a sequence based on the preceding context. However, NTP's focus on single-t…
Harnessing Test-time Adaptation for NLU tasks Involving Dialects of English
Duke Nguyen, Aditya Joshi, Flora Salim
Test-time domain adaptation (TTDA) is an excellent method which helps generalize models across domains, tasks, and distributions without the use of labeled datasets. Thus, TTDA is…
"Is Hate Lost in Translation?": Evaluation of Multilingual LGBTQIA+ Hate Speech Detection
Fai Leui Chan, Duke Nguyen, Aditya Joshi
This paper explores the challenges of detecting LGBTQIA+ hate speech of large language models across multiple languages, including English, Italian, Chinese and (code-switched) Eng…