6 papers
Evaluation-as-Search: Adaptive Discovery of Grounding Failures in Meeting Assistants
Sami Khairy, Yasaman Hosseinkashi, Vishak Gopal +1
LLM-powered meeting assistants are deployed at scale, yet systematic evaluation of their grounding fidelity remains limited to static benchmarks that miss failure modes tied to spe…
Offline Meta-learning for Real-time Bandwidth Estimation
Aashish Gottipati, Sami Khairy, Yasaman Hosseinkashi +4
Real-time video applications require dynamic bitrate adjustments based on network capacity, necessitating accurate bandwidth estimation (BWE). We introduce Ivy, a novel BWE method…
Human-in-the-Loop Bandwidth Estimation for Quality of Experience Optimization in Real-Time Video Communication
Sami Khairy, Gabriel Mittag, Vishak Gopal +1
The quality of experience (QoE) delivered by video conferencing systems is significantly influenced by accurately estimating the time-varying available bandwidth between the sender…
A multidimensional measurement of photorealistic avatar quality of experience
Ross Cutler, Babak Naderi, Vishak Gopal +1
Photorealistic avatars are human avatars that look, move, and talk like real people. The performance of photorealistic avatars has significantly improved recently based on objectiv…
Offline to Online Learning for Real-Time Bandwidth Estimation
Aashish Gottipati, Sami Khairy, Gabriel Mittag +2
Real-time video applications require accurate bandwidth estimation (BWE) to maintain user experience across varying network conditions. However, increasing network heterogeneity ch…
Streetwise Agents: Empowering Offline RL Policies to Outsmart Exogenous Stochastic Disturbances in RTC
Aditya Soni, Mayukh Das, Anjaly Parayil +8
The difficulty of exploring and training online on real production systems limits the scope of real-time online data/feedback-driven decision making. The most feasible approach is…