MOSS: A Production Framework for Monitoring and Diagnosing Semantic Failures in Search and Recommendation Systems

Alina Nesen, Prathyusha Kanmanth Reddy, David Relyea +4

Detecting semantic failures in production recommendation and search systems is hard: behavioral metrics lag by days, manual review does not scale, and most LLM evaluation framework…