Playing optical tweezers with deep reinforcement learning: in virtual, physical and augmented environments

Abstract

Reinforcement learning was carried out in a simulated environment to learn continuous velocity control over multiple motor axes. This was then applied to a real-world optical tweezers experiment with the objective of moving a laser-trapped microsphere to a target location whilst avoiding collisions with other free-moving microspheres. The concept of training a neural network in a virtual environment has significant potential in the application of machine learning for experimental optimization and control, as the neural network can discover optimal methods for problem solving without the risk of damage to equipment, and at a speed not limited by movement in the physical environment. As the neural network treats both virtual and physical environments equivalently, we show that the network can also be applied to an augmented environment, where a virtual environment is combined with the physical environment. This technique may have the potential to unlock capabilities associated with mixed and augmented reality, such as enforcing safety limits for machine motion or as a method of inputting observations from additional sensors.

References in corpus (16)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Continuous control with deep reinforcement learning
• Overcoming catastrophic forgetting in neural networks
• Playing Atari with Deep Reinforcement Learning
• Addressing Function Approximation Error in Actor-Critic Methods
• Neuromorphic Silicon Photonic Networks
• Human-level performance in first-person multiplayer games with population-based deep reinforcement learning
• StarCraft II: A New Challenge for Reinforcement Learning
• Deep Learning Microscopy
• Solving Rubik's Cube with a Robot Hand
• Deep Reinforcement Learning: An Overview
• Virtual to Real Reinforcement Learning for Autonomous Driving
• Language Understanding for Text-based Games Using Deep Reinforcement Learning
• Playing Doom with SLAM-Augmented Deep Reinforcement Learning
• Playing Text-Adventure Games with Graph-Based Deep Reinforcement Learning
• Interferobot: aligning an optical interferometer by a reinforcement learning agent