Generative AI for Self-Adaptive Systems: State of the Art and Research Roadmap

Abstract

Self-adaptive systems (SASs) are designed to handle changes and uncertainties through a feedback loop with four core functionalities: monitoring, analyzing, planning, and execution. Recently, generative artificial intelligence (GenAI), especially the area of large language models, has shown impressive performance in data comprehension and logical reasoning. These capabilities are highly aligned with the functionalities required in SASs, suggesting a strong potential to employ GenAI to enhance SASs. However, the specific benefits and challenges of employing GenAI in SASs remain unclear. Yet, providing a comprehensive understanding of these benefits and challenges is complex due to several reasons: limited publications in the SAS field, the technological and application diversity within SASs, and the rapid evolution of GenAI technologies. To that end, this paper aims to provide researchers and practitioners a comprehensive snapshot that outlines the potential benefits and challenges of employing GenAI's within SAS. Specifically, we gather, filter, and analyze literature from four distinct research fields and organize them into two main categories to potential benefits: (i) enhancements to the autonomy of SASs centered around the specific functions of the MAPE-K feedback loop, and (ii) improvements in the interaction between humans and SASs within human-on-the-loop settings. From our study, we outline a research roadmap that highlights the challenges of integrating GenAI into SASs. The roadmap starts with outlining key research challenges that need to be tackled to exploit the potential for applying GenAI in the field of SAS. The roadmap concludes with a practical reflection, elaborating on current shortcomings of GenAI and proposing possible mitigation strategies.

Accepted by ACM Transactions on Autonomous and Adaptive Systems

References in corpus (25)

• A Survey on Large Language Model based Autonomous Agents
• Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations
• A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly
• Graph of Thoughts: Solving Elaborate Problems with Large Language Models
• Practical Program Repair in the Era of Large Pre-trained Language Models
• The GOOSE Dataset for Perception in Unstructured Environments
• Fuzz4All: Universal Fuzzing with Large Language Models
• GPTScan: Detecting Logic Vulnerabilities in Smart Contracts by Combining GPT with Program Analysis
• Applying Machine Learning in Self-Adaptive Systems: A Systematic Literature Review
• ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing
• Graphologue: Exploring Large Language Model Responses with Interactive Diagrams
• Getting pwn'd by AI: Penetration Testing with Large Language Models
• Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repair
• LLMParser: An Exploratory Study on Using Large Language Models for Log Parsing
• A decoder-only foundation model for time-series forecasting
• A Survey on Hardware Accelerators for Large Language Models
• LLM-BT: Performing Robotic Adaptive Tasks based on Large Language Models and Behavior Trees
• The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Models
• Revisiting the Plastic Surgery Hypothesis via Large Language Models
• "My agent understands me better": Integrating Dynamic Human-like Memory Recall and Consolidation in LLM-Based Agents
• Dealing with Drift of Adaptation Spaces in Learning-based Self-Adaptive Systems using Lifelong Self-Adaptation
• Natural Language Dataset Generation Framework for Visualizations Powered by Large Language Models
• Exploiting Transformer in Sparse Reward Reinforcement Learning for Interpretable Temporal Logic Motion Planning
• BertRLFuzzer: A BERT and Reinforcement Learning Based Fuzzer
• Normative Requirements Operationalization with Large Language Models

Cited by in corpus (4)

• AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
• Generative AI for Requirements Engineering: A Systematic Literature Review
• Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey
• A Research Roadmap for Augmenting Software Engineering Processes and Software Products with Generative AI