A Survey of FPGA-Based Robotic Computing
arXiv:2009.06034
Abstract
Recent researches on robotics have shown significant improvement, spanning from algorithms, mechanics to hardware architectures. Robotics, including manipulators, legged robots, drones, and autonomous vehicles, are now widely applied in diverse scenarios. However, the high computation and data complexity of robotic algorithms pose great challenges to its applications. On the one hand, CPU platform is flexible to handle multiple robotic tasks. GPU platform has higher computational capacities and easy-touse development frameworks, so they have been widely adopted in several applications. On the other hand, FPGA-based robotic accelerators are becoming increasingly competitive alternatives, especially in latency-critical and power-limited scenarios. With specialized designed hardware logic and algorithm kernels, FPGA-based accelerators can surpass CPU and GPU in performance and energy efficiency. In this paper, we give an overview of previous work on FPGA-based robotic accelerators covering different stages of the robotic system pipeline. An analysis of software and hardware optimization techniques and main technical issues is presented, along with some commercial and space applications, to serve as a guide for future work.
To appear in IEEE Circuits and Systems Magazine (CAS-M), 2021
References in corpus (17)
- High-Speed Tracking with Kernelized Correlation Filters
- VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
- End to End Learning for Self-Driving Cars
- Fully Convolutional Networks for Semantic Segmentation
- Ternary Weight Networks
- YOLO9000: Better, Faster, Stronger
- Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving
- Pyramid Scene Parsing Network
- Embedded real-time stereo estimation via Semi-Global Matching on the GPU
- InfiniTAM v3: A Framework for Large-Scale 3D Reconstruction with Loop Closure
- Collaborative Large-Scale Dense 3D Reconstruction with Online Inter-Agent Pose Optimisation
- Real-Time Dense Stereo Matching With ELAS on FPGA Accelerated Embedded Devices
- AdaptivFloat: A Floating-point based Data Type for Resilient Deep Learning Inference
- Position-based Scaled Gradient for Model Quantization and Pruning
- AutoPilot: Automating SoC Design Space Exploration for SWaP Constrained Autonomous UAVs
- FP-Stereo: Hardware-Efficient Stereo Vision for Embedded Applications