From the 1 of 6 linked papers with an AI index.
6 papers
DAIF: A Data-Driven Intermediate Fusion Framework for Multimodal Supervised Learning via Approximate Message Passing
Sagnik Nandy, Samriddha Lahiry, Pragya Sur +1
Multimodal supervised learning seeks to leverage multiple heterogeneous data sources to improve predictive performance. A central challenge is determining the fusion granularity ac…
Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling
Yufan Li, Pragya Sur
The paper proposes an angular calibration method for high‑dimensional linear binary classifiers with Gaussian features, proving it yields well‑calibrated and Bregman‑optimal predic…
Multi-layer Cross-attention is Provably Optimal for Multi-modal In-context Learning
Nicholas Barnfield, Subhabrata Sen, Pragya Sur
Recent progress has rapidly advanced our understanding of the mechanisms underlying in-context learning in modern attention-based neural networks. However, existing results focus e…
Characterizing Finite-Dimensional Posterior Marginals in High-Dimensional GLMs via Leave-One-Out
Manuel Sáenz, Pragya Sur
We investigate Bayes posterior distributions in high-dimensional generalized linear models (GLMs) under the proportional asymptotics regime, where the number of features and sample…
Spectrum-Aware Debiasing: A Modern Inference Framework with Applications to Principal Components Regression
Yufan Li, Pragya Sur
Debiasing is a fundamental concept in high-dimensional statistics. While degrees-of-freedom adjustment is the state-of-the-art technique in high-dimensional linear regression, it i…
ROTI-GCV: Generalized Cross-Validation for right-ROTationally Invariant Data
Kevin Luo, Yufan Li, Pragya Sur
Two key tasks in high-dimensional regularized regression are tuning the regularization strength for accurate predictions and estimating the out-of-sample risk. It is known that the…