activity
20212024
most cited2-Level Reinforcement Learning for Ships on Inland Waterways: Path Planning and Following

3 citations · 6 across the 7 of their papers we have counts for

collaborators

7 papers

cs.LG2024

Self-organized free-flight arrival for urban air mobility

Martin Waltz, Ostap Okhrin, Michael Schultz

Urban air mobility is an innovative mode of transportation in which electric vertical takeoff and landing (eVTOL) vehicles operate between nodes called vertiports. We outline a sel…

cs.RO2023

Two-step dynamic obstacle avoidance

Fabian Hart, Martin Waltz, Ostap Okhrin

Dynamic obstacle avoidance (DOA) is a fundamental challenge for any autonomous vehicle, independent of whether it operates in sea, air, or land. This paper proposes a two-step arch…

eess.SY2023★ 3 cited

2-Level Reinforcement Learning for Ships on Inland Waterways: Path Planning and Following

Martin Waltz, Niklas Paulig, Ostap Okhrin

This paper proposes a realistic modularized framework for controlling autonomous surface vehicles (ASVs) on inland waterways (IWs) based on deep reinforcement learning (DRL). The f…

cs.LG2022

Spatial-temporal recurrent reinforcement learning for autonomous ships

Martin Waltz, Ostap Okhrin

This paper proposes a spatial-temporal recurrent neural network architecture for deep -networks that can be used to steer an autonomous ship. The network design makes it possibl…

q-fin.GN2022

Vulnerability-CoVaR: Investigating the Crypto-market

Martin Waltz, Abhay Kumar Singh, Ostap Okhrin

This paper proposes an important extension to Conditional Value-at-Risk (CoVaR), the popular systemic risk measure, and investigates its properties on the cryptocurrency market. Th…

cs.LG2022★ 1 cited

Addressing Maximization Bias in Reinforcement Learning with Two-Sample Testing

Martin Waltz, Ostap Okhrin

Value-based reinforcement-learning algorithms have shown strong results in games, robotics, and other real-world applications. Overestimation bias is a known threat to those algori…

cs.LG2021★ 2 cited

Missing Velocity in Dynamic Obstacle Avoidance based on Deep Reinforcement Learning

Fabian Hart, Martin Waltz, Ostap Okhrin

We introduce a novel approach to dynamic obstacle avoidance based on Deep Reinforcement Learning by defining a traffic type independent environment with variable complexity. Fillin…