activity
20232026
most citedMarMot: Metamorphic Runtime Monitoring of Autonomous Driving Systems

12 citations · 19 across the 15 of their papers we have counts for

collaborators

16 papers

cs.SE2026

Hype Meets Reality: Large Language Models as Mutators in Search-based Automated Program Repair of Simulink-Stateflow Models

Ayesha Irshad, Pablo Valle, Jon Ayerdi +1

Search-based Automated Program Repair (APR) techniques rely on carefully designed mutation operators to explore the space of candidate fixes. Recent advances in Large Language Mode…

cs.SE2026

Delta Debugging for Cyber-Physical Systems with Flaky Test Executions

Pablo Valle, Shaukat Ali, Aitor Arrieta

Simulation-based testing is widely used to validate Cyber-Physical Systems (CPSs), yet modern CPS simulators frequently exhibit non-deterministic (flaky) behavior, making failures…

cs.SE2026

MANGO: Automated Multi-Agent Test Oracle Generation for Vision-Language-Action Models

Pablo Valle, Shaukat Ali, Aitor Arrieta +1

Vision-Language-Action (VLA) models are emerging robotic control systems that integrate perception, language understanding, and action generation in a unified architecture. Existin…

cs.RO2026

FATE-VLA:Failue-aware test generation for vision-language-action models

Arusa Kanwal, Pablo Valle, Shaukat Ali +1

Vision-Language-Action (VLA) models are increasingly used as generalist robot policies, yet their evaluation still relies largely on static benchmarks that randomly sample task sce…

cs.SE2026

VISOR: A Vision-Language Model-based Test Oracle for Testing Robots

Prasun Saurabh, Pablo Valle, Aitor Arrieta +2

Testing robots requires assessing whether they perform their intended tasks correctly, dependably, and with high quality, a challenge known as the test oracle problem in software t…

cs.RO2026

Metamorphic Testing of Vision-Language Action-Enabled Robots

Pablo Valle, Sergio Segura, Shaukat Ali +1

Vision-Language-Action (VLA) models are multimodal robotic task controllers that, given an instruction and visual inputs, produce a sequence of low-level control actions (or motor…

cs.SE2026

Exploring the Potential of Large Language Models in Simulink-Stateflow Mutant Generation

Pablo Valle, Shaukat Ali, Aitor Arrieta

Mutation analysis is a powerful technique for assessing test-suite adequacy, yet conventional approaches suffer from generating redundant, equivalent, or non-executable mutants. Th…

cs.SE2025★ 2 cited

Evaluating Uncertainty and Quality of Vision-Language-Action-enabled Robots

Pablo Valle, Chengjie Lu, Shaukat Ali +1

Vision-Language-Action (VLA)-enabled robots integrate visual perception, natural language understanding, and action planning to interpret their environment, comprehend instructions…

cs.SE2025

Foundation Models for Software Engineering of Cyber-Physical Systems: the Road Ahead

Chengjie Lu, Pablo Valle, Jiahui Wu +4

Foundation Models (FMs), particularly Large Language Models (LLMs), are increasingly used to support various software engineering activities (e.g., coding and testing). Their adopt…

cs.SE2025

Red Teaming Contemporary AI Models: Insights from Spanish and Basque Perspectives

Miguel Romero-Arjona, Pablo Valle, Juan C. Alonso +7

The battle for AI leadership is on, with OpenAI in the United States and DeepSeek in China as key contenders. In response to these global trends, the Spanish government has propose…

cs.SE2025★ 3 cited

o3-mini vs DeepSeek-R1: Which One is Safer?

Aitor Arrieta, Miriam Ugarte, Pablo Valle +2

The irruption of DeepSeek-R1 constitutes a turning point for the AI industry in general and the LLMs in particular. Its capabilities have demonstrated outstanding performance in se…

cs.SE2025★ 1 cited

Early External Safety Testing of OpenAI's o3-mini: Insights from the Pre-Deployment Evaluation

Aitor Arrieta, Miriam Ugarte, Pablo Valle +2

Large Language Models (LLMs) have become an integral part of our daily lives. However, they impose certain risks, including those that can harm individuals' privacy, perpetuate bia…

cs.SE2025

Automated Repair of Cyber-Physical Systems

Pablo Valle

Cyber-Physical Systems (CPS) integrate digital technologies with physical processes and are common in different domains and industries, such as robotic systems, autonomous vehicles…

cs.SE2025

ASTRAL: Automated Safety Testing of Large Language Models

Miriam Ugarte, Pablo Valle, José Antonio Parejo +2

Large Language Models (LLMs) have recently gained attention due to their ability to understand and generate sophisticated human-like content. However, ensuring their safety is para…

cs.SE2024★ 1 cited

Search-based Automated Program Repair of CPS Controllers Modeled in Simulink-Stateflow

Aitor Arrieta, Pablo Valle, Shaukat Ali

Stateflow models are widely used in the industry to model the high-level control logic of Cyber-Physical Systems (CPSs) in Simulink--the defacto CPS simulator. Many approaches exis…

cs.SE2023★ 12 cited

MarMot: Metamorphic Runtime Monitoring of Autonomous Driving Systems

Jon Ayerdi, Asier Iriarte, Pablo Valle +3

Autonomous Driving Systems (ADSs) are complex Cyber-Physical Systems (CPSs) that must ensure safety even in uncertain conditions. Modern ADSs often employ Deep Neural Networks (DNN…