Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systems

Abstract

This paper was motivated by the problem of how to make robots fuse and transfer their experience so that they can effectively use prior knowledge and quickly adapt to new environments. To address the problem, we present a learning architecture for navigation in cloud robotic systems: Lifelong Federated Reinforcement Learning (LFRL). In the work, We propose a knowledge fusion algorithm for upgrading a shared model deployed on the cloud. Then, effective transfer learning methods in LFRL are introduced. LFRL is consistent with human cognitive science and fits well in cloud robotic systems. Experiments show that LFRL greatly improves the efficiency of reinforcement learning for robot navigation. The cloud robotic system deployment also shows that LFRL is capable of fusing prior knowledge. In addition, we release a cloud robotic navigation-learning website based on LFRL.

References in corpus (9)

• Progressive Neural Networks
• Federated Learning for Mobile Keyboard Prediction
• In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
• Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications
• Learning to Navigate in Complex Environments
• Reinforcement Learning with Unsupervised Auxiliary Tasks
• Neural SLAM: Learning to Explore with External Memory
• Policy Distillation
• Deep Reinforcement Learning

Cited by in corpus (52)

• Federated Learning for Internet of Things: A Comprehensive Survey
• A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
• FedML: A Research Library and Benchmark for Federated Machine Learning
• Federated Reinforcement Learning: Techniques, Applications, and Open Challenges
• A Systematic Literature Review on Federated Machine Learning: From A Software Engineering Perspective
• Federated Learning for Computationally-Constrained Heterogeneous Devices: A Survey
• Internet of Intelligence: A Survey on the Enabling Technologies, Applications, and Challenges
• An Overview of Federated Learning at the Edge and Distributed Ledger Technologies for Robotic and Autonomous Systems
• Federated Learning for Healthcare Informatics
• Decentralized Deep Learning for Multi-Access Edge Computing: A Survey on Communication Efficiency and Trustworthiness
• A Tutorial on Ultra-Reliable and Low-Latency Communications in 6G: Integrating Domain Knowledge into Deep Learning
• A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Things
• A Systematic Literature Review on Federated Learning: From A Model Quality Perspective
• Deep Learning for Embodied Vision Navigation: A Survey
• Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
• Homogeneous Learning: Self-Attention Decentralized Deep Learning
• Recognition of Pyralidae Insects Using Intelligent Monitoring Autonomous Robot Vehicle in Natural Farm Scene
• Applications of Federated Learning in Smart Cities: Recent Advances, Taxonomy, and Open Challenges
• EchoPFL: Asynchronous Personalized Federated Learning on Mobile Devices with On-Demand Staleness Control
• Combining Federated Learning and Control: A Survey
• An Improved Method for the Fitting and Prediction of the Number of COVID-19 Confirmed Cases Based on LSTM
• Federated Learning on Non-IID Data: A Survey
• Revocable Federated Learning: A Benchmark of Federated Forest
• Fed-EC: Bandwidth-Efficient Clustering-Based Federated Learning For Autonomous Visual Robot Navigation
• COVID-19 Public Opinion and Emotion Monitoring System Based on Time Series Thermal New Word Mining
• Blockchain-assisted Demonstration Cloning for Multi-Agent Deep Reinforcement Learning
• CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community
• Distributed Dynamic Map Fusion via Federated Learning for Intelligent Networked Vehicles
• AVDDPG: Federated reinforcement learning applied to autonomous platoon control
• Design and Implementation of A Novel Precision Irrigation Robot Based on An Intelligent Path Planning Algorithm
• Provably Efficient Cooperative Multi-Agent Reinforcement Learning with Function Approximation
• Personalized Federated Learning of Driver Prediction Models for Autonomous Driving
• Federated Imitation Learning: A Privacy Considered Imitation Learning Framework for Cloud Robotic Systems with Heterogeneous Sensor Data
• Multi-Task Federated Reinforcement Learning with Adversaries
• A Practical Marine Wireless Sensor Network Monitoring System Based on LoRa and MQTT
• Design of a Simplified Wireless Sensor Network Node based on MQTT Protocol
• Forecasting model based on information-granulated GA-SVR and ARIMA for producer price index
• A Novel DDoS Attack Detection Method Using Optimized Generalized Multiple Kernel Learning
• Federated Imitation Learning: A Novel Framework for Cloud Robotic Systems with Heterogeneous Sensor Data
• Provably Efficient Multi-Task Reinforcement Learning with Model Transfer
• DDoS Attack Detection Method Based on Network Abnormal Behavior in Big Data Environment
• DDoS attack detection method based on feature extraction of deep belief network
• Peer-Assisted Robotic Learning: A Data-Driven Collaborative Learning Approach for Cloud Robotic Systems
• Camouflage Design of Analysis Based on HSV Color Statistics and K-means Clustering
• Fault-Tolerant Federated Reinforcement Learning with Theoretical Guarantee
• To save the Environmental degradation: Please pay for ecosystem services!
• Options of Different Rescue Periods on Transport Tools
• Evaluation Pattern on Refugee Crisis
• Assessment of Urban Ecological Service value used in Urban Rail Transit Project
• A Books Recommendation Approach Based on Online Bookstore Data
• Adaptive DDoS attack detection method based on multiple-kernel learning
• Life detection strategy based on infrared vision and ultra-wideband radar data fusion