3 citations · 8 across the 11 of their papers we have counts for
11 papers
Learning to Decide with AI Assistance under Human-Alignment
Nina Corvelo Benz, Eleni Straitouri, Manuel Gomez-Rodriguez
It is widely agreed that when AI models assist decision-makers in high-stakes domains by predicting an outcome of interest, they should communicate the confidence of their predicti…
Generating Robust Portfolios of Optimization Models using Large Language Models
Eleni Straitouri, Cheol Woo Kim, Milind Tambe
Mathematical optimization is a powerful tool for structured decision-making across domains such as resource allocation and planning. Formulating optimization models faithful to rea…
Narrowing Action Choices with AI Improves Human Sequential Decisions
Eleni Straitouri, Stratis Tsirtsis, Ander Artola Velasco +1
Recent work has shown that, in classification tasks, it is possible to design decision support systems that do not require human experts to understand when to cede agency to a clas…
Evaluation of Large Language Models via Coupled Token Generation
Nina Corvelo Benz, Stratis Tsirtsis, Eleni Straitouri +4
State of the art large language models rely on randomization to respond to a prompt. As an immediate consequence, a model may respond differently to the same prompt if asked multip…
Counterfactual Token Generation in Large Language Models
Ivi Chatzi, Nina Corvelo Benz, Eleni Straitouri +2
"Sure, I am happy to generate a story for you: Captain Lyra stood at the helm of her trusty ship, the Maelstrom's Fury, gazing out at the endless sea. [...] Lyra's eyes welled up w…
Controlling Counterfactual Harm in Decision Support Systems Based on Prediction Sets
Eleni Straitouri, Suhas Thejaswi, Manuel Gomez Rodriguez
Decision support systems based on prediction sets help humans solve multiclass classification tasks by narrowing down the set of potential label values to a subset of them, namely…
Towards Human-AI Complementarity with Prediction Sets
Giovanni De Toni, Nastaran Okati, Suhas Thejaswi +2
Decision support systems based on prediction sets have proven to be effective at helping human experts solve classification tasks. Rather than providing single-label predictions, t…
Prediction-Powered Ranking of Large Language Models
Ivi Chatzi, Eleni Straitouri, Suhas Thejaswi +1
Large language models are often ranked according to their level of alignment with human preferences -- a model is better than other models if its outputs are more frequently prefer…
Designing Decision Support Systems Using Counterfactual Prediction Sets
Eleni Straitouri, Manuel Gomez Rodriguez
Decision support systems for classification tasks are predominantly designed to predict the value of the ground truth labels. However, since their predictions are not perfect, thes…
Improving Expert Predictions with Conformal Prediction
Eleni Straitouri, Lequn Wang, Nastaran Okati +1
Automated decision support systems promise to help human experts solve multiclass classification tasks more efficiently and accurately. However, existing systems typically require…
Reinforcement Learning Under Algorithmic Triage
Eleni Straitouri, Adish Singla, Vahid Balazadeh Meresht +1
Methods to learn under algorithmic triage have predominantly focused on supervised learning settings where each decision, or prediction, is independent of each other. Under algorit…