46 citations · 51 across the 5 of their papers we have counts for
6 papers
Decision Titan: Test-Time Training for Long-Term Memory in Offline Reinforcement Learning
Jude Waide, Robert Lieck
Long-term dependencies remain a major challenge for sequential decision-making in the field of AI: RNNs suffer from vanishing gradients and the limited expressivity of vector-based…
Adaptive Graph Learning from Spatial Information for Surgical Workflow Anticipation
Francis Xiatian Zhang, Jingjing Deng, Robert Lieck +1
Surgical workflow anticipation is the task of predicting the timing of relevant surgical events from live video data, which is critical in Robotic-Assisted Surgery (RAS). Accurate…
Planning Transformer: Long-Horizon Offline Reinforcement Learning with Planning Tokens
Joseph Clinton, Robert Lieck
Supervised learning approaches to offline reinforcement learning, particularly those utilizing the Decision Transformer, have shown effectiveness in continuous environments and for…
Recursive Bayesian Networks: Generalising and Unifying Probabilistic Context-Free Grammars and Dynamic Bayesian Networks
Robert Lieck, Martin Rohrmeier
Probabilistic context-free grammars (PCFGs) and dynamic Bayesian networks (DBNs) are widely used sequence models with complementary strengths and limitations. While PCFGs allow for…
Towards Moral Autonomous Systems
Vicky Charisi, Louise Dennis, Michael Fisher +6
Both the ethics of autonomous systems and the problems of their technical implementation have by now been studied in some detail. Less attention has been given to the areas in whic…
The Advantage of Cross Entropy over Entropy in Iterative Information Gathering
Johannes Kulick, Robert Lieck, Marc Toussaint
Gathering the most information by picking the least amount of data is a common task in experimental design or when exploring an unknown environment in reinforcement learning and ro…