output
19922026
Showing 2018 · cs.LGShow all

16 papers · 2 filters

cs.LG2018★ 92 cited

MMA Training: Direct Input Space Margin Maximization through Adversarial Training

Gavin Weiguang Ding, Yash Sharma, Kry Yik Chau Lui +1

We study adversarial robustness of neural networks from a margin maximization perspective, where margins are defined as the distances from inputs to a classifier's decision boundar…

cs.LG2018★ 8 cited

The Utility of Sparse Representations for Control in Reinforcement Learning

Vincent Liu, Raksha Kumaraswamy, Lei Le +1

We investigate sparse representations for control in reinforcement learning. While these representations are widely used in computer vision, their prevalence in reinforcement learn…

cs.LG2018★ 3 cited

QUOTA: The Quantile Option Architecture for Reinforcement Learning

Shangtong Zhang, Borislav Mavrin, Linglong Kong +2

In this paper, we propose the Quantile Option Architecture (QUOTA) for exploration based on recent advances in distributional reinforcement learning (RL). In QUOTA, decision making…

cs.LG2018★ 2 cited

ACE: An Actor Ensemble Algorithm for Continuous Control with Tree Search

Shangtong Zhang, Hao Chen, Hengshuai Yao

In this paper, we propose an actor ensemble algorithm, named ACE, for continuous control with a deterministic policy in reinforcement learning. In ACE, we use actor ensemble (i.e.,…

cs.LG2018★ 14 cited

Online Off-policy Prediction

Sina Ghiassian, Andrew Patterson, Martha White +2

This paper investigates the problem of online prediction learning, where learning proceeds continuously as the agent interacts with an environment. The predictions made by the agen…

cs.LG2018★ 4 cited

An Off-policy Policy Gradient Theorem Using Emphatic Weightings

Ehsan Imani, Eric Graves, Martha White

Policy gradient methods are widely used for control in reinforcement learning, particularly for the continuous action setting. There have been a host of theoretically sound algorit…

cs.LG2018★ 2 cited

Context-Dependent Upper-Confidence Bounds for Directed Exploration

Raksha Kumaraswamy, Matthew Schlegel, Adam White +1

Directed exploration strategies for reinforcement learning are critical for learning an optimal policy in a minimal number of interactions with the environment. Many algorithms use…

cs.LG2018★ 3 cited

Greedy Actor-Critic: A New Conditional Cross-Entropy Method for Policy Improvement

Samuel Neumann, Sungsu Lim, Ajin Joseph +3

Many policy gradient methods are variants of Actor-Critic (AC), where a value function (critic) is learned to facilitate updating the parameterized policy (actor). The update to th…

cs.LG2018★ 6 cited

Per-decision Multi-step Temporal Difference Learning with Control Variates

Kristopher De Asis, Richard S. Sutton

Multi-step temporal difference (TD) learning is an important approach in reinforcement learning, as it unifies one-step TD learning with Monte Carlo methods in a way where intermed…

cs.LG2018★ 8 cited

LeapsAndBounds: A Method for Approximately Optimal Algorithm Configuration

Gellért Weisz, András György, Csaba Szepesvári

We consider the problem of configuring general-purpose solvers to run efficiently on problem instances drawn from an unknown distribution. The goal of the configurator is to find a…

cs.LG2018★ 21 cited

General Value Function Networks

Matthew Schlegel, Andrew Jacobsen, Zaheer Abbas +3

State construction is important for learning in partially observable environments. A general purpose strategy for state construction is to learn the state update using a Recurrent…

cs.LG2018★ 3 cited

Cleaning up the neighborhood: A full classification for adversarial partial monitoring

Tor Lattimore, Csaba Szepesvari

Partial monitoring is a generalization of the well-known multi-armed bandit framework where the loss is not directly observed by the learner. We complete the classification of fini…

cs.LG2018★ 8 cited

Improving GAN Training via Binarized Representation Entropy (BRE) Regularization

Yanshuai Cao, Gavin Weiguang Ding, Kry Yik-Chau Lui +1

We propose a novel regularizer to improve the training of Generative Adversarial Networks (GANs). The motivation is that when the discriminator D spreads out its model capacity in…

cs.LG2018★ 5 cited

TIDBD: Adapting Temporal-difference Step-sizes Through Stochastic Meta-descent

Alex Kearney, Vivek Veeriah, Jaden B. Travnik +2

In this paper, we introduce a method for adapting the step-sizes of temporal difference (TD) learning. The performance of TD methods often depends on well chosen step-sizes, yet fe…

cs.LG2018★ 47 cited

Model-Free Linear Quadratic Control via Reduction to Expert Prediction

Yasin Abbasi-Yadkori, Nevena Lazic, Csaba Szepesvari

Model-free approaches for reinforcement learning (RL) and continuous control find policies based only on past states and rewards, without fitting a model of the system dynamics. Th…

cs.LG2018★ 6 cited

A Block-wise, Asynchronous and Distributed ADMM Algorithm for General Form Consensus Optimization

Rui Zhu, Di Niu, Zongpeng Li

Many machine learning models, including those with non-smooth regularizers, can be formulated as consensus optimization problems, which can be solved by the alternating direction m…