Fiber: A Platform for Efficient Development and Distributed Training for Reinforcement Learning and Population-Based Methods
arXiv:2003.11164
Abstract
Recent advances in machine learning are consistently enabled by increasing amounts of computation. Reinforcement learning (RL) and population-based methods in particular pose unique challenges for efficiency and flexibility to the underlying distributed computing frameworks. These challenges include frequent interaction with simulations, the need for dynamic scaling, and the need for a user interface with low adoption cost and consistency across different backends. In this paper we address these challenges while still retaining development efficiency and flexibility for both research and practical applications by introducing Fiber, a scalable distributed computing framework for RL and population-based methods. Fiber aims to significantly expand the accessibility of large-scale parallel computation to users of otherwise complicated RL and population-based approaches without the need to for specialized computational expertise.
References in corpus (16)
- Evolution Strategies as a Scalable Alternative to Reinforcement Learning
- Robots that can adapt like animals
- Human-level performance in first-person multiplayer games with population-based deep reinforcement learning
- Emergence of Locomotion Behaviours in Rich Environments
- IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
- Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning
- Horovod: fast and easy distributed deep learning in TensorFlow
- Distributed Prioritized Experience Replay
- Illuminating search spaces by mapping elites
- Massively Parallel Methods for Deep Reinforcement Learning
- Go-Explore: a New Approach for Hard-Exploration Problems
- Dopamine: A Research Framework for Deep Reinforcement Learning
- Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutions
- Horizon: Facebook's Open Source Applied Reinforcement Learning Platform
- ELF: An Extensive, Lightweight and Flexible Research Platform for Real-time Strategy Games
- AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligence