145 citations · 424 across the 41 of their papers we have counts for
5 papers · 1 filter
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States
Ziqiao Wang, Yongyi Mao
Stochastic differential equations (SDEs) have been shown recently to characterize well the dynamics of training machine learning models with SGD. When the generalization error of t…
Information-Theoretic Analysis of Unsupervised Domain Adaptation
Ziqiao Wang, Yongyi Mao
This paper uses information-theoretic tools to analyze the generalization error in unsupervised domain adaptation (UDA). We present novel upper bounds for two notions of generaliza…
A Semi-blind PCA-based Foreground Subtraction Method for 21 cm Intensity Mapping
Shifan Zuo, Xuelei Chen, Yi Mao
The Principal Component Analysis (PCA) method and the Singular Value Decomposition (SVD) method are widely used for foreground subtraction in 21 cm intensity mapping experiments. W…
Cross Domain Few-Shot Learning via Meta Adversarial Training
Jirui Qi, Richong Zhang, Chune Li +1
Few-shot relation classification (RC) is one of the critical problems in machine learning. Current research merely focuses on the set-ups that both training and testing are from th…
Dual Contrastive Learning: Text Classification via Label-Aware Data Augmentation
Qianben Chen, Richong Zhang, Yaowei Zheng +1
Contrastive learning has achieved remarkable success in representation learning via self-supervision in unsupervised settings. However, effectively adapting contrastive learning to…