Powderworld: A Platform for Understanding Generalization via Rich Task Distributions

Kevin Frans, Phillip Isola

One of the grand challenges of reinforcement learning is the ability to generalize to new tasks. However, general agents require a set of rich, diverse tasks to train on. Designing…