6 papers
-Stability for Boosting Vector-Valued Prediction
Jian Qian, Shu Ge
Despite the widespread use of boosting in structured prediction, a general theoretical understanding of aggregation beyond scalar prediction remains incomplete. We study vector-val…
Normalization in Attention Dynamics
Nikita Karagodin, Shu Ge, Yury Polyanskiy +1
We study the effect of normalization schemes on token representations in deep transformers. Modeling their evolution as interacting particles on the sphere, we show that normalizat…
Sigmoid-FTRL: Design-Based Adaptive Neyman Allocation for AIPW Estimators
Fangyi Chen, Shu Ge, Jian Qian +1
We consider the problem of Adaptive Neyman Allocation for the class of AIPW estimators in a design-based setting, where potential outcomes and covariates are deterministic. As each…
Bridging multiple worlds: multi-marginal optimal transport for causal partial-identification problem
Zijun Gao, Shu Ge, Jian Qian
Under the prevalent potential outcome model in causal inference, each unit is associated with multiple potential outcomes but at most one of which is observed, leading to many caus…
A Collapsible Polynomial Hierarchy for Promise Problems
Chirag Falor, Shu Ge, Anand Natarajan
The polynomial hierarchy has been widely studied in classical complexity theory. In this paper, we will generalize some commonly known results about the polynomial hierarchy to a v…
A Knowledge Distillation Approach for Sepsis Outcome Prediction from Multivariate Clinical Time Series
Anna Wong, Shu Ge, Nassim Oufattole +4
Sepsis is a life-threatening condition triggered by an extreme infection response. Our objective is to forecast sepsis patient outcomes using their medical history and treatments,…