47 citations · 106 across the 29 of their papers we have counts for
9 papers · 1 filter
When to Follow the Teacher: Advantage-Based On-Policy Distillation
Mahdi Sabbaghi, George Pappas, Hamed Hassani +1
Online Policy Distillation (OPD) often outperforms offline methods such as Supervised Fine-Tuning (SFT) by training on trajectories sampled directly from the student. However, stan…
Edit Discovery in Human-AI Interactions
Alireza Mirrokni, Shayan Kiyani, George Pappas +1
Human-AI interactions are becoming a rich source of data for improving AI systems: while many model responses are already satisfactory, others expose failures that could become val…
Disagreement-Guided Weak-to-Strong Routing
Sima Noorani, Shayan Kiyani, George Pappas +1
Small language models are increasingly deployed on edge devices and robotic systems to meet cost and latency constraints, yet their limited capabilities can make reliable deploymen…
Strategic Decision Support for AI Agents
Shayan Kiyani, Sima Noorani, George Pappas +1
Traditionally, decision support studies how humans use machine learning models to make better decisions. In modern agentic systems, this division of roles is increasingly reversed:…
Conformal Risk-Averse Decision Making with Action Conditional Guarantee
Zihan Zhu, Shayan Kiyani, George Pappas +1
Reliable decision making pipelines powered by machine learning models require uncertainty quantification (UQ) methods that come with explicit safety guarantees. Conformal predictio…
InfoSFT: Learn More and Forget Less with Information-Aware Token Weighting
Mahdi Sabbaghi, George Pappas, Adel Javanmard +1
Supervised fine-tuning (SFT) provides the standard approach for teaching LLMs new behaviors from offline expert demonstrations. However, standard SFT uniformly fits all samples --…
Multi-Round Human-AI Collaboration with User-Specified Requirements
Sima Noorani, Shayan Kiyani, Hamed Hassani +1
As humans increasingly rely on multiround conversational AI for high stakes decisions, principled frameworks are needed to ensure such interactions reliably improve decision qualit…
When to Trust the Cheap Check: Weak and Strong Verification for Reasoning
Shayan Kiyani, Sima Noorani, George Pappas +1
Reasoning with LLMs increasingly unfolds inside a broader verification loop. Internally, systems use cheap checks, such as self-consistency or proxy rewards, which we call weak ver…
Robust Policy Optimization to Prevent Catastrophic Forgetting
Mahdi Sabbaghi, George Pappas, Adel Javanmard +1
Large language models are commonly trained through multi-stage post-training: first via RLHF, then fine-tuned for other downstream objectives. Yet even small downstream updates can…