5 papers
OGAM: Connecting Systematic Testing to Runtime Assurance through Object-Grounded Attention Monitoring for VLA Policies
Haki Darwish, Xiangyu Yin, Changwen Li +3
Benchmarks expose vision-language-action (VLA) policies to few canonical instructions, while exhaustive deployment testing is impossible. We introduce Object-Grounded Attention Mon…
Validating Generalist Robots with Situation Calculus and STL Falsification
Changwen Li, Rongjie Yan, Chih-Hong Cheng +1
Generalist robots are becoming a reality, capable of interpreting natural language instructions and executing diverse operations. However, their validation remains challenging beca…
Cumulative Consensus Score: Label-Free and Model-Agnostic Evaluation of Object Detectors in Deployment
Avinaash Manoharan, Xiangyu Yin, Domenik Helm +1
Evaluating object detection models in deployment is challenging because ground-truth annotations are rarely available. We introduce the Cumulative Consensus Score (CCS), a label-fr…
Rethinking Code Review Workflows with LLM Assistance: An Empirical Study
Fannar Steinn Aðalsteinsson, Björn Borgar Magnússon, Mislav Milicevic +2
Code reviews are a critical yet time-consuming aspect of modern software development, increasingly challenged by growing system complexity and the demand for faster delivery. This…
Runtime Monitoring DNN-Based Perception
Chih-Hong Cheng, Michael Luttenberger, Rongjie Yan
Deep neural networks (DNNs) are instrumental in realizing complex perception systems. As many of these applications are safety-critical by design, engineering rigor is required to…