2 papers
cs.LG2026
MA-Bench: Measuring Operational Planning in Language Models
Rodney Lafuente-Mercado, Robert Sincero, Phil Sage +1
How well can a language model turn a large, incomplete and partly contradictory body of documents into a plan when no single correct answer exists? We introduce Mission Analysis (M…
stat.ML2024
A Decision-driven Methodology for Designing Uncertainty-aware AI Self-Assessment
Gregory Canal, Vladimir Leung, Philip Sage +2
Artificial intelligence (AI) has revolutionized decision-making processes and systems throughout society and, in particular, has emerged as a significant technology in high-impact…