4 papers
Document Understanding, Measurement, and Manipulation Using Category Theory
Jared Claypoole, Yunye Gong, Noson S. Yanofsky +1
We apply category theory to extract multimodal document structure which leads us to develop information theoretic measures, content summarization and extension, and self-supervised…
Uncertainty Propagation through Trained Deep Neural Networks Using Factor Graphs
Angel Daruna, Yunye Gong, Abhinav Rajvanshi +2
Predictive uncertainty estimation remains a challenging problem precluding the use of deep neural networks as subsystems within safety-critical applications. Aleatoric uncertainty…
BloomVQA: Assessing Hierarchical Multi-modal Comprehension
Yunye Gong, Robik Shrestha, Jared Claypoole +4
We propose a novel VQA dataset, BloomVQA, to facilitate comprehensive evaluation of large vision-language models on comprehension tasks. Unlike current benchmarks that often focus…
Confidence Calibration for Systems with Cascaded Predictive Modules
Yunye Gong, Yi Yao, Xiao Lin +2
Existing conformal prediction algorithms estimate prediction intervals at target confidence levels to characterize the performance of a regression model on new test samples. Howeve…