Showing 2025Show all
2 papers · 1 filter
cs.LG2025
Normalization in Attention Dynamics
Nikita Karagodin, Shu Ge, Yury Polyanskiy +1
We study the effect of normalization schemes on token representations in deep transformers. Modeling their evolution as interacting particles on the sphere, we show that normalizat…
math.ST2025
Sigmoid-FTRL: Design-Based Adaptive Neyman Allocation for AIPW Estimators
Fangyi Chen, Shu Ge, Jian Qian +1
We consider the problem of Adaptive Neyman Allocation for the class of AIPW estimators in a design-based setting, where potential outcomes and covariates are deterministic. As each…