10 citations · 17 across the 4 of their papers we have counts for
4 papers
Vcc: Scaling Transformers to 128K Tokens or More by Prioritizing Important Tokens
Zhanpeng Zeng, Cole Hawkins, Mingyi Hong +4
Transformers are central in modern natural language processing and computer vision applications. Despite recent works devoted to reducing the quadratic cost of such models (as a fu…
Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognition
Haotao Wang, Aston Zhang, Yi Zhu +4
Existing out-of-distribution (OOD) detection methods are typically benchmarked on training sets with balanced class distributions. However, in real-world applications, it is common…
Removing Batch Normalization Boosts Adversarial Training
Haotao Wang, Aston Zhang, Shuai Zheng +3
Adversarial training (AT) defends deep neural networks against adversarial attacks. One challenge that limits its practical application is the performance degradation on clean samp…
Analysis and Modeling of Social Influence in High Performance Computing Workloads
Shuai Zheng, Zon-Yin Shae, Xiangliang Zhang +2
Social influence among users (e.g., collaboration on a project) creates bursty behavior in the underlying high performance computing (HPC) workloads. Using representative HPC and c…