497 citations · 2.1k across the 297 of their papers we have counts for
4 papers · 2 filters
Learning and Planning for Time-Varying MDPs Using Maximum Likelihood Estimation
Melkior Ornik, Ufuk Topcu
This paper proposes a formal approach to online learning and planning for agents operating in a priori unknown, time-varying environments. The proposed method computes the maximall…
Identifying Sparse Low-Dimensional Structures in Markov Chains: A Nonnegative Matrix Factorization Approach
Mahsa Ghasemi, Abolfazl Hashemi, Haris Vikalo +1
We consider the problem of learning low-dimensional representations for large-scale Markov chains. We formulate the task of representation learning as that of mapping the state spa…
An Encoder-Decoder Based Approach for Anomaly Detection with Application in Additive Manufacturing
Baihong Jin, Yingshui Tan, Alexander Nettekoven +4
We present a novel unsupervised deep learning approach that utilizes the encoder-decoder architecture for detecting anomalies in sequential sensor data collected during industrial…
Algorithms for Fairness in Sequential Decision Making
Min Wen, Osbert Bastani, Ufuk Topcu
It has recently been shown that if feedback effects of decisions are ignored, then imposing fairness constraints such as demographic parity or equality of opportunity can actually…