8 papers
Learning to Decide with AI Assistance under Human-Alignment
Nina Corvelo Benz, Eleni Straitouri, Manuel Gomez-Rodriguez
It is widely agreed that when AI models assist decision-makers in high-stakes domains by predicting an outcome of interest, they should communicate the confidence of their predicti…
Generating Robust Portfolios of Optimization Models using Large Language Models
Eleni Straitouri, Cheol Woo Kim, Milind Tambe
Mathematical optimization is a powerful tool for structured decision-making across domains such as resource allocation and planning. Formulating optimization models faithful to rea…
Evaluation of Large Language Models via Coupled Token Generation
Nina Corvelo Benz, Stratis Tsirtsis, Eleni Straitouri +4
State of the art large language models rely on randomization to respond to a prompt. As an immediate consequence, a model may respond differently to the same prompt if asked multip…
Narrowing Action Choices with AI Improves Human Sequential Decisions
Eleni Straitouri, Stratis Tsirtsis, Ander Artola Velasco +1
Recent work has shown that, in classification tasks, it is possible to design decision support systems that do not require human experts to understand when to cede agency to a clas…
Counterfactual Token Generation in Large Language Models
Ivi Chatzi, Nina Corvelo Benz, Eleni Straitouri +2
"Sure, I am happy to generate a story for you: Captain Lyra stood at the helm of her trusty ship, the Maelstrom's Fury, gazing out at the endless sea. [...] Lyra's eyes welled up w…
Controlling Counterfactual Harm in Decision Support Systems Based on Prediction Sets
Eleni Straitouri, Suhas Thejaswi, Manuel Gomez Rodriguez
Decision support systems based on prediction sets help humans solve multiclass classification tasks by narrowing down the set of potential label values to a subset of them, namely…