EvoJAX: Hardware-Accelerated Neuroevolution

Abstract

Evolutionary computation has been shown to be a highly effective method for training neural networks, particularly when employed at scale on CPU clusters. Recent work have also showcased their effectiveness on hardware accelerators, such as GPUs, but so far such demonstrations are tailored for very specific tasks, limiting applicability to other domains. We present EvoJAX, a scalable, general purpose, hardware-accelerated neuroevolution toolkit. Building on top of the JAX library, our toolkit enables neuroevolution algorithms to work with neural networks running in parallel across multiple TPU/GPUs. EvoJAX achieves very high performance by implementing the evolution algorithm, neural network and task all in NumPy, which is compiled just-in-time to run on accelerators. We provide extensible examples of EvoJAX for a wide range of tasks, including supervised learning, reinforcement learning and generative art. Since EvoJAX can find solutions to most of these tasks within minutes on a single accelerator, compared to hours or days when using CPUs, our toolkit can significantly shorten the iteration cycle of evolutionary computation experiments. EvoJAX is available at https://github.com/google/evojax

arXiv commentGECCO 2022. Project website at https://github.com/google/evojax

References in corpus (11)

• Sequence to Sequence Learning with Neural Networks
• An overview of gradient descent optimization algorithms
• Evolution Strategies as a Scalable Alternative to Reinforcement Learning
• OpenAI Gym
• Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning
• Population Based Training of Neural Networks
• L2 Regularization versus Batch and Weight Normalization
• How Does Learning Rate Decay Help Modern Neural Networks?
• Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutions
• Learning to Predict Without Looking Ahead: World Models Without Forward Prediction
• Modern Evolution Strategies for Creativity: Fitting Concrete Images and Abstract Concepts

Cited by in corpus (7)

• Evolutionary Reinforcement Learning: A Survey
• Evolutionary Optimization of Model Merging Recipes
• Rethinking Population-assisted Off-policy Reinforcement Learning
• Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunities
• GPU-accelerated Evolutionary Multiobjective Optimization Using Tensorized RVEA
• Neuroevolution of Physics-Informed Neural Nets: Benchmark Problems and Comparative Results
• Curiosity creates Diversity in Policy Search