activity
20192026
most citedApproximate Dynamic Programming with Neural Networks in Linear Discrete Action Spaces

5 citations · 10 across the 8 of their papers we have counts for

collaborators

8 papers

math.OC2026

On the Entropy in Last-Mile Logistics

Berry Gerrits, Wouter van Heeswijk

Last-mile logistics (LML) is characterized by high fragmentation, yet existing research treats this as an exogenous constraint rather than a quantifiable and optimizable system pro…

cs.AI2025

Deep Learning--Accelerated Multi-Start Large Neighborhood Search for Real-time Freight Bundling

Haohui Zhang, Wouter van Heeswijk, Xinyu Hu +2

Online Freight Exchange Systems (OFEX) play a crucial role in modern freight logistics by facilitating real-time matching between shippers and carrier. However, efficient combinato…

cs.LG2025

Machine Learning Predictions for Traffic Equilibria in Road Renovation Scheduling

Robbert Bosch, Wouter van Heeswijk, Patricia Rogetzer +1

Accurately estimating the impact of road maintenance schedules on traffic conditions is important because maintenance operations can substantially worsen congestion if not carefull…

cs.LG2023★ 2 cited

Dynamic Neighborhood Construction for Structured Large Discrete Action Spaces

Fabian Akkerman, Julius Luy, Wouter van Heeswijk +1

Large discrete action spaces (LDAS) remain a central challenge in reinforcement learning. Existing solution approaches can handle unstructured LDAS with up to a few million actions…

cs.LG2022★ 3 cited

Natural Policy Gradients In Reinforcement Learning Explained

W. J. A. van Heeswijk

Traditional policy gradient methods are fundamentally flawed. Natural gradients converge quicker and better, forming the foundation of contemporary Reinforcement Learning such as T…

cs.LG2020

A Gentle Lecture Note on Filtrations in Reinforcement Learning

W. J. A. van Heeswijk

This note aims to provide a basic intuition on the concept of filtrations as used in the context of reinforcement learning (RL). Filtrations are often used to formally define RL pr…

cs.AI2020

Smart Containers With Bidding Capacity: A Policy Gradient Algorithm for Semi-Cooperative Learning

Wouter van Heeswijk

Smart modular freight containers -- as propagated in the Physical Internet paradigm -- are equipped with sensors, data storage capability and intelligence that enable them to route…

cs.LG2019★ 5 cited

Approximate Dynamic Programming with Neural Networks in Linear Discrete Action Spaces

Wouter van Heeswijk, Han La Poutré

Real-world problems of operations research are typically high-dimensional and combinatorial. Linear programs are generally used to formulate and efficiently solve these large decis…