5 papers · 1 filter
Risk-Averse Decision Making with Multi-Level Reliability Guarantees
Amirmohammad Farzaneh, Osvaldo Simeone
Many applications in engineering, including wireless broadcasting, require designs that provide performance certificates at different target outage levels. This paper studies the p…
Conformal Risk-Averse Decision Making with Optimized Certainty Equivalent Risk Control
Amirmohammad Farzaneh, Osvaldo Simeone
We study risk-averse decision making, in which an agent selects actions while being uncertain about the true system state. The risk is measured via optimized certainty equivalent (…
Think Short, Defer Smart, Act, and Repeat: Calibrated Reasoning and Uncertainty-Aware Deferral for Edge LLM Agents
Amirmohammad Farzaneh, Osvaldo Simeone
LLM agents following the ReAct paradigm are promising enablers of complex multi-step tasks, including multi-hop question answering, code generation, and control of physical AI syst…
Statistically Valid Post-Training Hyperparameter Selection: From Tuning to Guarantees
Amirmohammad Farzaneh, Osvaldo Simeone
Post-training hyperparameter selection is a critical step in the deployment of modern artificial intelligence systems, given the need to tune degrees of freedom of pre-trained mode…
Post-Selection Distributional Model Evaluation
Amirmohammad Farzaneh, Osvaldo Simeone
Formal model evaluation methods typically certify that a model satisfies a prescribed target key performance indicator (KPI) level. However, in many applications, the relevant targ…