Deep Reinforcement Learning in Ice Hockey for Context-Aware Player Evaluation
arXiv:1805.11088 · doi:10.24963/ijcai.2018/478
Abstract
A variety of machine learning models have been proposed to assess the performance of players in professional sports. However, they have only a limited ability to model how player performance depends on the game context. This paper proposes a new approach to capturing game context: we apply Deep Reinforcement Learning (DRL) to learn an action-value Q function from 3M play-by-play events in the National Hockey League (NHL). The neural network representation integrates both continuous context signals and game history, using a possession-based LSTM. The learned Q-function is used to value players' actions under different game contexts. To assess a player's overall performance, we introduce a novel Game Impact Metric (GIM) that aggregates the values of the player's actions. Empirical Evaluation shows GIM is consistent throughout a play season, and correlates highly with standard success measures and future salary.
This paper has been accepted by IJCAI 2018
Cited by in corpus (5)
- Data-driven Analysis for Understanding Team Sports Behaviors
- Action valuation of on- and off-ball soccer players based on multi-agent deep reinforcement learning
- Cracking the Black Box: Distilling Deep Sports Analytics
- A framework for the fine-grained evaluation of the instantaneous expected value of soccer possessions
- CAMP: A Context-Aware Cricket Players Performance Metric