activity
20122026
most citedHierarchical Solution of Markov Decision Processes using Macro-actions

226 citations · 541 across the 30 of their papers we have counts for

collaborators
Showing cs.AIShow all

8 papers · 1 filter

cs.AI2017

Detection of Abnormal Input-Output Associations

Charmgil Hong, Siqi Liu, Milos Hauskrecht

We study a novel outlier detection problem that aims to identify abnormal input-output associations in data, whose instances consist of multi-dimensional input (context) and output…

cs.AI2015★ 4 cited

MCODE: Multivariate Conditional Outlier Detection

Charmgil Hong, Milos Hauskrecht

Outlier detection aims to identify unusual data instances that deviate from expected patterns. The outlier detection is particularly challenging when outliers are context dependent…

cs.AI2013★ 4 cited

Sparse Linear Dynamical System with Its Application in Multivariate Clinical Time Series

Zitao Liu, Milos Hauskrecht

Linear Dynamical System (LDS) is an elegant mathematical framework for modeling and learning multivariate time series. However, in general, it is difficult to set the dimension of…

cs.AI2013★ 226 cited

Hierarchical Solution of Markov Decision Processes using Macro-actions

Milos Hauskrecht, Nicolas Meuleau, Leslie Pack Kaelbling +2

We investigate the use of temporally abstract actions, or macro-actions, in the solution of Markov decision processes. Unlike current models that combine both primitive actions and…

cs.AI2013★ 4 cited

A Clustering Approach to Solving Large Stochastic Matching Problems

Milos Hauskrecht, Eli Upfal

In this work we focus on efficient heuristics for solving a class of stochastic planning problems that arise in a variety of business, investment, and industrial applications. The…

cs.AI2012★ 8 cited

Monte-Carlo optimizations for resource allocation problems in stochastic network systems

Milos Hauskrecht, Tomas Singliar

Real-world distributed systems and networks are often unreliable and subject to random failures of its components. Such a stochastic behavior affects adversely the complexity of op…