65 citations · 115 across the 13 of their papers we have counts for
13 papers · 1 filter
Alternatives To Next Token Prediction In Text Generation -- A Survey
Charlie Wyatt, Aditya Joshi, Flora Salim
The paradigm of Next Token Prediction (NTP) has driven the unprecedented success of Large Language Models (LLMs), but is also the source of their most persistent weaknesses such as…
Experiences from Creating a Benchmark for Sentiment Classification for Varieties of English
Dipankar Srirag, Jordan Painter, Aditya Joshi +1
Existing benchmarks often fail to account for linguistic diversity, like language variants of English. In this paper, we share our experiences from our ongoing project of building…
BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pretraining of BabyLM
Zhewen Shen, Aditya Joshi, Ruey-Cheng Chen
Children from bilingual backgrounds benefit from interactions with parents and teachers to re-acquire their heritage language. In this paper, we investigate how this insight from b…
Overview of the 2023 ICON Shared Task on Gendered Abuse Detection in Indic Languages
Aatman Vaidya, Arnav Arora, Aditya Joshi +1
This paper reports the findings of the ICON 2023 on Gendered Abuse Detection in Indic Languages. The shared task deals with the detection of gendered abuse in online text. The shar…
Relation Extraction from News Articles (RENA): A Tool for Epidemic Surveillance
Jaeff Hong, Duong Dung, Danielle Hutchinson +7
Relation Extraction from News Articles (RENA) is a browser-based tool designed to extract key entities and their semantic relationships in English language news articles related to…
Stacking the Odds: Transformer-Based Ensemble for AI-Generated Text Detection
Duke Nguyen, Khaing Myat Noe Naing, Aditya Joshi
This paper reports our submission under the team name `SynthDetectives' to the ALTA 2023 Shared Task. We use a stacking ensemble of Transformers for the task of AI-generated text d…