7 papers
Quantifying System-Level Harms from AI Adoption in Complex Sociotechnical Systems
Paul Vautravers, Oliver Chalkley, Gabriel Downer +2
Artificial Intelligence (AI) is increasingly integrated into complex sociotechnical systems, including Critical National Infrastructure (CNI), where harms emerge from interactions…
Human--LLM Collaboration Is Transforming Complexity Metrics in Scientific Texts
R. Alexander Bentley, Blai Vidiella, Damian J. Ruck +3
While human language has long been studied as a complex system, Large Language Models (LLMs) are rapidly becoming contributors to its dynamics. Because LLMs are trained on human la…
Scalable Evaluation of the Realism of Synthetic Environmental Augmentations in Images
Damian J. Ruck, Paul Vautravers, Oliver Chalkley +1
Evaluation of AI systems often requires synthetic test cases, particularly for rare or safety-critical conditions that are difficult to observe in operational data. Generative AI o…
Text2VLM: Adapting Text-Only Datasets to Evaluate Alignment Training in Visual Language Models
Gabriel Downer, Sean Craven, Damian Ruck +1
The increasing integration of Visual Language Models (VLMs) into AI systems necessitates robust model alignment, especially when handling multimodal content that combines text and…
Engagement Outweighs Exposure to Partisan and Unreliable News within Google Search
Ronald E. Robertson, Jon Green, Damian J. Ruck +3
If popular online platforms systematically expose their users to partisan and unreliable news, they could potentially contribute to societal issues like rising political polarizati…
CLARITY -- Comparing heterogeneous data using dissimiLARITY
Daniel J. Lawson, Vinesh Solanki, Igor Yanovich +3
Integrating datasets from different disciplines is hard because the data are often qualitatively different in meaning, scale, and reliability. When two datasets describe the same e…