4 papers
Evaluation-as-Search: Adaptive Discovery of Grounding Failures in Meeting Assistants
Sami Khairy, Yasaman Hosseinkashi, Vishak Gopal +1
LLM-powered meeting assistants are deployed at scale, yet systematic evaluation of their grounding fidelity remains limited to static benchmarks that miss failure modes tied to spe…
Offline Meta-learning for Real-time Bandwidth Estimation
Aashish Gottipati, Sami Khairy, Yasaman Hosseinkashi +4
Real-time video applications require dynamic bitrate adjustments based on network capacity, necessitating accurate bandwidth estimation (BWE). We introduce Ivy, a novel BWE method…
Human-in-the-Loop Bandwidth Estimation for Quality of Experience Optimization in Real-Time Video Communication
Sami Khairy, Gabriel Mittag, Vishak Gopal +1
The quality of experience (QoE) delivered by video conferencing systems is significantly influenced by accurately estimating the time-varying available bandwidth between the sender…
A multidimensional measurement of photorealistic avatar quality of experience
Ross Cutler, Babak Naderi, Vishak Gopal +1
Photorealistic avatars are human avatars that look, move, and talk like real people. The performance of photorealistic avatars has significantly improved recently based on objectiv…