activity
20102019
most citedOnline Planning Algorithms for POMDPs

516 citations · 800 across the 9 of their papers we have counts for

collaborators

13 papers

cs.RO2019

Agent Prioritization for Autonomous Navigation

Khaled S. Refaat, Kai Ding, Natalia Ponomareva +1

In autonomous navigation, a planning system reasons about other agents to plan a safe and plausible trajectory. Before planning starts, agents are typically processed with computat…

cs.LG2014

Normalized Online Learning

Stephane Ross, Paul Mineiro, John Langford

We introduce online learning algorithms which are independent of feature scales, proving regret bounds dependent on the ratio of scales existent in the data rather than the absolut…

cs.LG2014★ 116 cited

Reinforcement and Imitation Learning via Interactive No-Regret Learning

Stephane Ross, J. Andrew Bagnell

Recent work has demonstrated that problems-- particularly imitation learning and structured prediction-- where a learner's predictions influence the input-distribution it is tested…

cs.LG2014★ 9 cited

A Credit Assignment Compiler for Joint Prediction

Kai-Wei Chang, He He, Hal Daumé +2

Many machine learning applications involve jointly predicting multiple mutually dependent output variables. Learning to search is a family of methods where the complex decision pro…

cs.AI2014★ 516 cited

Online Planning Algorithms for POMDPs

Stéphane Ross, Joelle Pineau, Sébastien Paquet +1

Partially Observable Markov Decision Processes (POMDPs) provide a rich framework for sequential decision-making under uncertainty in stochastic domains. However, solving a POMDP is…

cs.LG2013

Knapsack Constrained Contextual Submodular List Prediction with Application to Multi-document Summarization

Jiaji Zhou, Stephane Ross, Yisong Yue +2

We study the problem of predicting a set or list of options under knapsack constraint. The quality of such lists are evaluated by a submodular reward function that measures both qu…

cs.LG2013★ 9 cited

Normalized Online Learning

Stephane Ross, Paul Mineiro, John Langford

We introduce online learning algorithms which are independent of feature scales, proving regret bounds dependent on the ratio of scales existent in the data rather than the absolut…

cs.LG2013★ 17 cited

Learning Policies for Contextual Submodular Prediction

Stephane Ross, Jiaji Zhou, Yisong Yue +2

Many prediction domains, such as ad placement, recommendation, trajectory prediction, and document summarization, require predicting a set or list of options. Such lists are often…

cs.RO2012★ 4 cited

Learning Monocular Reactive UAV Control in Cluttered Natural Environments

Stephane Ross, Narek Melik-Barkhudarov, Kumar Shaurya Shankar +4

Autonomous navigation for large Unmanned Aerial Vehicles (UAVs) is fairly straight-forward, as expensive sensors and monitoring devices can be employed. In contrast, obstacle avoid…

cs.AI2012★ 51 cited

Model-Based Bayesian Reinforcement Learning in Large Structured Domains

Stephane Ross, Joelle Pineau

Model-based Bayesian reinforcement learning has generated significant interest in the AI community as it provides an elegant solution to the optimal exploration-exploitation tradeo…

cs.LG2012★ 67 cited

Agnostic System Identification for Model-Based Reinforcement Learning

Stephane Ross, J. Andrew Bagnell

A fundamental problem in control is to learn a model of a system from observations that is useful for controller synthesis. To provide good performance guarantees, existing methods…

cs.LG2011★ 11 cited

Stability Conditions for Online Learnability

Stephane Ross, J. Andrew Bagnell

Stability is a general notion that quantifies the sensitivity of a learning algorithm's output to small change in the training dataset (e.g. deletion or replacement of a single tra…

cs.LG2010

A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning

Stephane Ross, Geoffrey J. Gordon, J. Andrew Bagnell

Sequential prediction problems such as imitation learning, where future observations depend on previous predictions (actions), violate the common i.i.d. assumptions made in statist…