3 citations · 3 across the 14 of their papers we have counts for
12 papers · 1 filter
Language Models Have Interpretable Narrative Mechanisms
David Yiyang Liu, Aditya Joshi, Paul Dawson +1
We investigate whether language models contain internal components that contribute to representing narrativity, the degree to which a text exhibits narrative properties. Across GPT…
A Hybrid Framework for Song Lyric Annotation Based on Human-LLM Alignment
Rashini Liyanarachchi, Frank Tran, Md Mahmudul Hasan +2
Emotion recognition of song lyrics is a challenging task since lyrics may not necessarily align with the overall emotion of a song. As a result, lyrics annotation remains largely u…
Far Out: Evaluating Language Models on Slang in Australian and Indian English
Deniz Kaya Dilsiz, Dipankar Srirag, Aditya Joshi
Language models exhibit systematic performance gaps when processing text in non-standard language varieties, yet their ability to comprehend variety-specific slang remains underexp…
Narrative Theory-Driven LLM Methods for Automatic Story Generation and Understanding: A Survey
David Y. Liu, Aditya Joshi, Paul Dawson
Applications of narrative theories using large language models (LLMs) deliver promising methods in automatic story generation and understanding tasks. Our survey examines how natur…
In Vino Veritas and Vulnerabilities: Examining LLM Safety via Drunk Language Inducement
Anudeex Shetty, Aditya Joshi, Salil S. Kanhere
Humans are susceptible to undesirable behaviours and privacy leaks under the influence of alcohol. This paper investigates drunk language, i.e., text written under the influence of…
LangLingual: A Personalised, Exercise-oriented English Language Learning Tool Leveraging Large Language Models
Sammriddh Gupta, Sonit Singh, Aditya Joshi +1
Language educators strive to create a rich experience for learners, while they may be restricted in the extend of feedback and practice they can provide. We present the design and…
Predicting the Target Word of Game-playing Conversations using a Low-Rank Dialect Adapter for Decoder Models
Dipankar Srirag, Aditya Joshi, Jacob Eisenstein
Dialect adapters that improve the performance of LLMs for NLU tasks on certain sociolects/dialects/national varieties ('dialects' for the sake of brevity) have been reported for en…
BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pretraining of BabyLM
Zhewen Shen, Aditya Joshi, Ruey-Cheng Chen
Children from bilingual backgrounds benefit from interactions with parents and teachers to re-acquire their heritage language. In this paper, we investigate how this insight from b…
Evaluating Dialect Robustness of Language Models via Conversation Understanding
Dipankar Srirag, Nihar Ranjan Sahoo, Aditya Joshi
With an evergrowing number of LLMs reporting superlative performance for English, their ability to perform equitably for different dialects of English (, dialect rob…
Overview of the 2023 ICON Shared Task on Gendered Abuse Detection in Indic Languages
Aatman Vaidya, Arnav Arora, Aditya Joshi +1
This paper reports the findings of the ICON 2023 on Gendered Abuse Detection in Indic Languages. The shared task deals with the detection of gendered abuse in online text. The shar…
Natural Language Processing for Dialects of a Language: A Survey
Aditya Joshi, Raj Dabre, Diptesh Kanojia +4
State-of-the-art natural language processing (NLP) models are trained on massive training corpora, and report a superlative performance on evaluation datasets. This survey delves i…
Evaluation of large language models using an Indian language LGBTI+ lexicon
Aditya Joshi, Shruta Rawat, Alpana Dange
Large language models (LLMs) are typically evaluated on the basis of task-based benchmarks such as MMLU. Such benchmarks do not examine responsible behaviour of LLMs in specific co…