activity
20132025
most citedCan You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

924 citations · 5.3k across the 63 of their papers we have counts for

collaborators
Showing 2023Show all

7 papers · 1 filter

cs.CL2023★ 2 cited

Self-Evaluation Improves Selective Generation in Large Language Models

Jie Ren, Yao Zhao, Tu Vu +2

Safe deployment of large language models (LLMs) may benefit from a reliable method for assessing their generated content to determine when to abstain or to selectively generate. Wh…

cs.CV2023

Informative Priors Improve the Reliability of Multimodal Clinical Data Classification

L. Julian Lechuga Lopez, Tim G. J. Rudner, Farah E. Shamout

Machine learning-aided clinical decision support has the potential to significantly improve patient care. However, existing efforts in this domain for principled quantification of…

stat.ML2023★ 3 cited

Morse Neural Networks for Uncertainty Quantification

Benoit Dherin, Huiyi Hu, Jie Ren +2

We introduce a new deep generative model useful for uncertainty quantification: the Morse neural network, which generalizes the unnormalized Gaussian densities to have modes of hig…

cs.CV2023★ 1 cited

Building One-class Detector for Anything: Open-vocabulary Zero-shot OOD Detection Using Text-image Models

Yunhao Ge, Jie Ren, Jiaping Zhao +4

We focus on the challenge of out-of-distribution (OOD) detection in deep learning models, a crucial aspect in ensuring reliability. Despite considerable effort, the problem remains…

cs.LG2023

What Are Effective Labels for Augmented Data? Improving Calibration and Robustness with AutoLabel

Yao Qin, Xuezhi Wang, Balaji Lakshminarayanan +2

A wide breadth of research has devised data augmentation approaches that can improve both accuracy and generalization performance for neural networks. However, augmented data can e…

cs.LG2023

Pushing the Accuracy-Group Robustness Frontier with Introspective Self-play

Jeremiah Zhe Liu, Krishnamurthy Dj Dvijotham, Jihyeon Lee +4

Standard empirical risk minimization (ERM) training can produce deep neural network (DNN) models that are accurate on average but under-perform in under-represented population subg…

cs.LG2023★ 9 cited

A Simple Zero-shot Prompt Weighting Technique to Improve Prompt Ensembling in Text-Image Models

James Urquhart Allingham, Jie Ren, Michael W Dusenberry +5

Contrastively trained text-image models have the remarkable ability to perform zero-shot classification, that is, classifying previously unseen images into categories that the mode…