Agents that Listen: High-Throughput Reinforcement Learning with Multiple Sensory Systems

Shashank Hegde, Anssi Kanervisto, Aleksei Petrenko

Humans and other intelligent animals evolved highly sophisticated perception systems that combine multiple sensory modalities. On the other hand, state-of-the-art artificial agents…