6 papers
Formal Methods Meet LLMs: Auditing, Monitoring, and Intervention for Compliance of Advanced AI Systems
Parand A. Alamdari, Toryn Q. Klassen, Sheila A. McIlraith
We examine one particular dimension of AI governance: how to monitor and audit AI-enabled products and services throughout the AI development lifecycle, from pre-deployment testing…
Ground-Compose-Reinforce: Grounding Language in Agentic Behaviours using Limited Data
Andrew C. Li, Toryn Q. Klassen, Andrew Wang +2
Grounding language in perception and action is a key challenge when building situated agents that can interact with humans, or other agents, via language. In the past, addressing t…
Pluralistic Alignment Over Time
Toryn Q. Klassen, Parand A. Alamdari, Sheila A. McIlraith
If an AI system makes decisions over time, how should we evaluate how aligned it is with a group of stakeholders (who may have conflicting values and preferences)? In this position…
Being Considerate as a Pathway Towards Pluralistic Alignment for Agentic AI
Parand A. Alamdari, Toryn Q. Klassen, Rodrigo Toro Icarte +1
Pluralistic alignment is concerned with ensuring that an AI system's objectives and behaviors are in harmony with the diversity of human values and perspectives. In this paper we s…
Policy Aggregation
Parand A. Alamdari, Soroush Ebadian, Ariel D. Procaccia
We consider the challenge of AI value alignment with multiple individuals that have different reward functions and optimal policies in an underlying Markov decision process. We for…
Jump Starting Bandits with LLM-Generated Prior Knowledge
Parand A. Alamdari, Yanshuai Cao, Kevin H. Wilson
We present substantial evidence demonstrating the benefits of integrating Large Language Models (LLMs) with a Contextual Multi-Armed Bandit framework. Contextual bandits have been…