activity
20122022
most citedNon-Deterministic Policies in Markovian Decision Processes

22 citations · 65 across the 9 of their papers we have counts for

collaborators

9 papers

stat.ML2022

Distribution Embedding Networks for Generalization from a Diverse Set of Classification Tasks

Lang Liu, Mahdi Milani Fard, Sen Zhao

We propose Distribution Embedding Networks (DEN) for classification with small data. In the same spirit of meta-learning, DEN learns from a diverse set of training tasks with the g…

cs.LG2021★ 2 cited

Optimizing Black-box Metrics with Iterative Example Weighting

Gaurush Hiranandani, Jatin Mathur, Harikrishna Narasimhan +2

We consider learning to optimize a classification metric defined by a black-box function of the confusion matrix. Such black-box learning settings are ubiquitous, for example, when…

cs.LG2020★ 4 cited

Optimizing Black-box Metrics with Adaptive Surrogates

Qijia Jiang, Olaoluwa Adigun, Harikrishna Narasimhan +2

We address the problem of training models with black-box and hard-to-optimize metrics by expressing the metric as a monotonic function of a small number of easy-to-optimize surroga…

cs.LG2018★ 16 cited

Proxy Fairness

Maya Gupta, Andrew Cotter, Mahdi Milani Fard +1

We consider the problem of improving fairness when one lacks access to a dataset labeled with protected groups, making it difficult to take advantage of strategies that can improve…

stat.ML2018★ 6 cited

Metric-Optimized Example Weights

Sen Zhao, Mahdi Milani Fard, Harikrishna Narasimhan +1

Real-world machine learning applications often have complex test metrics, and may have training and test data that are not identically distributed. Motivated by known connections b…

cs.AI2014★ 22 cited

Non-Deterministic Policies in Markovian Decision Processes

Mahdi Milani Fard, Joelle Pineau

Markovian processes have long been used to model stochastic environments. Reinforcement learning has emerged as a framework to solve sequential planning and decision-making problem…

cs.LG2013

Efficient Learning and Planning with Compressed Predictive States

William L. Hamilton, Mahdi Milani Fard, Joelle Pineau

Predictive state representations (PSRs) offer an expressive framework for modelling partially observable systems. By compactly representing systems as functions of observable quant…

cs.LG2012★ 10 cited

Bellman Error Based Feature Generation using Random Projections on Sparse Spaces

Mahdi Milani Fard, Yuri Grinberg, Amir-massoud Farahmand +2

We address the problem of automatic generation of features for value function approximation. Bellman Error Basis Functions (BEBFs) have been shown to improve the error of policy ev…

cs.LG2012★ 5 cited

PAC-Bayesian Policy Evaluation for Reinforcement Learning

Mahdi MIlani Fard, Joelle Pineau, Csaba Szepesvari

Bayesian priors offer a compact yet general means of incorporating domain knowledge into many learning tasks. The correctness of the Bayesian analysis and inference, however, large…