An Application of Deep Reinforcement Learning to Algorithmic Trading

Abstract

This scientific research paper presents an innovative approach based on deep reinforcement learning (DRL) to solve the algorithmic trading problem of determining the optimal trading position at any point in time during a trading activity in stock markets. It proposes a novel DRL trading strategy so as to maximise the resulting Sharpe ratio performance indicator on a broad range of stock markets. Denominated the Trading Deep Q-Network algorithm (TDQN), this new trading strategy is inspired from the popular DQN algorithm and significantly adapted to the specific algorithmic trading problem at hand. The training of the resulting reinforcement learning (RL) agent is entirely based on the generation of artificial trajectories from a limited set of stock market historical data. In order to objectively assess the performance of trading strategies, the research paper also proposes a novel, more rigorous performance assessment methodology. Following this new performance assessment approach, promising results are reported for the TDQN strategy.

Preprint submitted to Elsevier journal "Expert Systems with Applications"

References in corpus (3)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• A Brief Survey of Deep Reinforcement Learning
• A Survey of Deep Reinforcement Learning in Video Games

Cited by in corpus (8)

• The Evolution of Reinforcement Learning in Quantitative Finance: A Survey
• A Deep Reinforcement Learning Approach for Security-Aware Service Acquisition in IoT
• Reinforcement Learning in Non-Markov Market-Making
• An Artificial Intelligence Solution for Electricity Procurement in Forward Markets
• Robust Risk-Sensitive Reinforcement Learning Agents for Trading Markets
• Deep Reinforcement Learning for Robust Goal-Based Wealth Management
• A Deep Reinforcement Learning Trader without Offline Training
• TradeR: Practical Deep Hierarchical Reinforcement Learning for Trade Execution