4 citations · 7 across the 9 of their papers we have counts for
10 papers
SLMEval: Entropy-Based Calibration for Human-Aligned Evaluation of Large Language Models
Roland Daynauth, Christopher Clarke, Krisztian Flautner +2
The LLM-as-a-Judge paradigm offers a scalable, reference-free approach for evaluating language models. Although several calibration techniques have been proposed to better align th…
Ranking Unraveled: Recipes for LLM Rankings in Head-to-Head AI Combat
Roland Daynauth, Christopher Clarke, Krisztian Flautner +2
Deciding which large language model (LLM) to use is a complex challenge. Pairwise ranking has emerged as a new method for evaluating human preferences for LLMs. This approach entai…
PEFT-U: Parameter-Efficient Fine-Tuning for User Personalization
Christopher Clarke, Yuzhao Heng, Lingjia Tang +1
The recent emergence of Large Language Models (LLMs) has heralded a new era of human-AI interaction. These sophisticated models, exemplified by Chat-GPT and its successors, have ex…
Guylingo: The Republic of Guyana Creole Corpora
Christopher Clarke, Roland Daynauth, Charlene Wilkinson +2
While major languages often enjoy substantial attention and resources, the linguistic diversity across the globe encompasses a multitude of smaller, indigenous, and regional langua…
MTP: A Meaning-Typed Language Abstraction for AI-Integrated Programming
Jayanaka L. Dantanarayana, Yiping Kang, Kugesan Sivasothynathan +6
Software development is shifting from traditional programming to AI-integrated applications that leverage generative AI and large language models (LLMs) during runtime. However, in…
One Agent Too Many: User Perspectives on Approaches to Multi-agent Conversational AI
Christopher Clarke, Karthik Krishnamurthy, Walter Talamonti +3
Conversational agents have been gaining increasing popularity in recent years. Influenced by the widespread adoption of task-oriented agents such as Apple Siri and Amazon Alexa, th…
Label Agnostic Pre-training for Zero-shot Text Classification
Christopher Clarke, Yuzhao Heng, Yiping Kang +3
Conventional approaches to text classification typically assume the existence of a fixed set of predefined labels to which a given text can be classified. However, in real-world ap…
One Agent To Rule Them All: Towards Multi-agent Conversational AI
Christopher Clarke, Joseph Joshua Peper, Karthik Krishnamurthy +6
The increasing volume of commercially available conversational agents (CAs) on the market has resulted in users being burdened with learning and adopting multiple agents to accompl…
Towards Personalized Intelligence at Scale
Yiping Kang, Ashish Mahendra, Christopher Clarke +2
Personalized Intelligence (PI) is the problem of providing customized AI experiences tailored to each individual user. In many applications, PI is preferred or even required. Exist…
An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction
Stefan Larson, Anish Mahendran, Joseph J. Peper +8
Task-oriented dialog systems need to know when a query falls outside their range of supported intents, but current text classification corpora only define label sets that cover eve…