3 papers
cs.CL2024
RAGProbe: An Automated Approach for Evaluating RAG Applications
Shangeetha Sivasothy, Scott Barnett, Stefanus Kurniawan +2
Retrieval Augmented Generation (RAG) is increasingly being used when building Generative AI applications. Evaluating these applications and RAG pipelines is mostly done manually, v…
cs.LG2024
Minimising changes to audit when updating decision trees
Anj Simmons, Scott Barnett, Anupam Chaudhuri +2
Interpretable models are important, but what happens when the model is updated on new training data? We propose an algorithm for updating a decision tree while minimising the numbe…
cs.SE2024
Large language models for generating rules, yay or nay?
Shangeetha Sivasothy, Scott Barnett, Rena Logothetis +4
Engineering safety-critical systems such as medical devices and digital health intervention systems is complex, where long-term engagement with subject-matter experts (SMEs) is nee…