Reinforcement learning for hardware acceleration and system-level optimization on FPGA and integrated-circuit platforms: A survey

Abstract

Reinforcement learning (RL) enables adaptive and autonomous decision-making in embedded, edge, and heterogeneous computing systems. Field-programmable gate arrays (FPGAs) and integrated circuits (ICs) offer low latency, energy efficiency, and architectural flexibility for RL deployment, while introducing challenges in resource constraints, implementation complexity, and hardware-algorithm co-design. This review surveys more than 100 studies on RL implementations across FPGA and IC platforms, emphasizing architectures, implementation strategies, performance evaluation, and applications. The literature is organized by RL family, including model-based Markov decision processes, classical value-based methods, deep RL, actor-critic, policy-gradient, and multi-agent approaches. We further classify studies by abstraction level, hardware realization strategy, and application domain, examining how RL algorithms map onto reconfigurable and fixed hardware. Unlike surveys restricted to particular algorithms or platforms, this work provides a unified analysis of FPGA and IC implementations, covering acceleration, reconfigurable architectures, energy-aware control, and system-level optimization. Comparative assessments consider resource utilization, latency, throughput, power consumption, and reported performance gains. Finally, we identify recurring architectural patterns, practical limitations, open challenges, and research directions for efficient RL-driven hardware systems. The survey offers a consolidated reference for researchers developing and evaluating RL solutions on specialized hardware.

References in corpus (10)

• UAV Trajectory Planning for AoI-Minimal Data Collection in UAV-Aided IoT Networks by Transformer
• Automatic Speech Recognition using Advanced Deep Learning Approaches: A survey
• Machine Learning for the Control and Monitoring of Electric Machine Drives: Advances and Trends
• Realizing a deep reinforcement learning agent discovering real-time feedback control strategies for a quantum system
• A Robust Cross-Domain IDS using BiGRU-LSTM-Attention for Medical and Industrial IoT Security
• Advanced Deep Learning and Large Language Models: Comprehensive Insights for Cancer Detection
• Cohmeleon: Learning-Based Orchestration of Accelerator Coherence in Heterogeneous SoCs
• Advanced Persistent Threats (APT) Attribution Using Deep Reinforcement Learning
• Accelerating Deep Neuroevolution on Distributed FPGAs for Reinforcement Learning Problems
• Hierarchical Graph Neural Network for Compressed Speech Steganalysis

Cited by in corpus (1)

• Recent Advances in Transformer and Large Language Models for UAV Applications