DeepPool: Distributed Model-free Algorithm for Ride-sharing using Deep Reinforcement Learning

Abstract

The success of modern ride-sharing platforms crucially depends on the profit of the ride-sharing fleet operating companies, and how efficiently the resources are managed. Further, ride-sharing allows sharing costs and, hence, reduces the congestion and emission by making better use of vehicle capacities. In this work, we develop a distributed model-free, DeepPool, that uses deep Q-network (DQN) techniques to learn optimal dispatch policies by interacting with the environment. Further, DeepPool efficiently incorporates travel demand statistics and deep learning models to manage dispatching vehicles for improved ride sharing services. Using real-world dataset of taxi trip records in New York City, DeepPool performs better than other strategies, proposed in the literature, that do not consider ride sharing or do not dispatch the vehicles to regions where the future demand is anticipated. Finally, DeepPool can adapt rapidly to dynamic environments since it is implemented in a distributed manner in which each vehicle solves its own DQN individually without coordination.

Cited by in corpus (19)

• Reinforcement Learning for Ridesharing: An Extended Survey
• Proximal Policy Optimization-based Transmit Beamforming and Phase-shift Design in an IRS-aided ISAC System for the THz Band
• Deep Reinforcement Learning and Transportation Research: A Comprehensive Review
• A Modular and Transferable Reinforcement Learning Framework for the Fleet Rebalancing Problem
• Dynamic resource matching in manufacturing using deep reinforcement learning
• Deep Reinforcement Learning for Demand Driven Services in Logistics and Transportation Systems: A Survey
• On the Approximation of Cooperative Heterogeneous Multi-Agent Reinforcement Learning (MARL) using Mean Field Control (MFC)
• Efficient Ridesharing Dispatch Using Multi-Agent Reinforcement Learning
• Deep Reinforcement Learning for Crowdsourced Urban Delivery: System States Characterization, Heuristics-guided Action Choice, and Rule-Interposing Integration
• BMG-Q: Localized Bipartite Match Graph Attention Q-Learning for Ride-Pooling Order Dispatch
• CoordiQ : Coordinated Q-learning for Electric Vehicle Charging Recommendation
• DROP: Deep relocating option policy for optimal ride-hailing vehicle repositioning
• A Probabilistic Approach for Demand-Aware Ride-Sharing Optimization
• dFDA-VeD: A Dynamic Future Demand Aware Vehicle Dispatching System
• Computation and Communication Co-Design for Real-Time Monitoring and Control in Multi-Agent Systems
• D-ACC: Dynamic Adaptive Cruise Control for Highways with Ramps Based on Deep Q-Learning
• Communication Efficient Parallel Reinforcement Learning
• H-TD2: Hybrid Temporal Difference Learning for Adaptive Urban Taxi Dispatch
• The Gradient Convergence Bound of Federated Multi-Agent Reinforcement Learning with Efficient Communication