A simple squared-error reformulation for ordinal classification

Abstract

In this paper, we explore ordinal classification (in the context of deep neural networks) through a simple modification of the squared error loss which not only allows it to not only be sensitive to class ordering, but also allows the possibility of having a discrete probability distribution over the classes. Our formulation is based on the use of a softmax hidden layer, which has received relatively little attention in the literature. We empirically evaluate its performance on the Kaggle diabetic retinopathy dataset, an ordinal and high-resolution dataset and show that it outperforms all of the baselines employed.

v1: Camera-ready abstract for NIPS for Health Workshop (2016) v2: Clean-up of some sections, added appendix section where we briefly explore optimisation of quadratic weighted kappa (QWK)

References in corpus (2)

• On The Direct Maximization of Quadratic Weighted Kappa
• A neural network approach to ordinal regression

Cited by in corpus (4)

• Class Distance Weighted Cross Entropy Loss for Classification of Disease Severity
• Unimodal probability distributions for deep ordinal classification
• A Novel Variational Autoencoder with Applications to Generative Modelling, Classification, and Ordinal Regression
• Deep Ordinal Regression for Pledge Specificity Prediction