Identifying and Benchmarking Natural Out-of-Context Prediction Problems

David Madras, Richard Zemel

Deep learning systems frequently fail at out-of-context (OOC) prediction, the problem of making reliable predictions on uncommon or unusual inputs or subgroups of the training dist…