Deep Lattice Networks and Partial Monotonic Functions

Abstract

We propose learning deep models that are monotonic with respect to a user-specified set of inputs by alternating layers of linear embeddings, ensembles of lattices, and calibrators (piecewise linear functions), with appropriate constraints for monotonicity, and jointly training the resulting network. We implement the layers and projections with new computational graph nodes in TensorFlow and use the ADAM optimizer and batched stochastic gradients. Experiments on benchmark and real-world datasets show that six-layer monotonic deep lattice networks achieve state-of-the art performance for classification and regression with monotonicity guarantees.

9 pages, NIPS 2017

References in corpus (1)

• Adam: A Method for Stochastic Optimization

Cited by in corpus (5)

• Monotonic Cardinality Estimation of Similarity Selection: A Deep Learning Approach
• Deep neural networks for choice analysis: Enhancing behavioral regularity with gradient regularization
• Consistent and Flexible Selectivity Estimation for High-Dimensional Data
• Robust and Provably Monotonic Networks
• Monotone-Value Neural Networks: Exploiting Preference Monotonicity in Combinatorial Assignment