2 citations · 2 across the 4 of their papers we have counts for
4 papers
Attention-Only White-Box Transformer via LeJEPA-Based Self-Supervised Pretraining
Yang Bai, Linyuan Wang, Haoyang Jiang +3
Existing studies on self-supervised learning for white-box networks typically decouple the derivation of white-box networks via optimization algorithms from self-supervised learnin…
Interpretable and Sparse Linear Attention with Decoupled Membership-Subspace Modeling via MCR2 Objective
Tianyuan Liu, Libin Hou, Linyuan Wang +1
Maximal Coding Rate Reduction (MCR2)-driven white-box transformer, grounded in structured representation learning, unifies interpretability and efficiency, providing a reliable whi…
Dense Optimizer : An Information Entropy-Guided Structural Search Method for Dense-like Neural Network Design
Liu Tianyuan, Hou Libin, Wang Linyuan +2
Dense Convolutional Network has been continuously refined to adopt a highly efficient and compact architecture, owing to its lightweight and efficient structure. However, the curre…
Dynamic Stochastic Ensemble with Adversarial Robust Lottery Ticket Subnetworks
Qi Peng, Wenlin Liu, Ruoxi Qin +3
Adversarial attacks are considered the intrinsic vulnerability of CNNs. Defense strategies designed for attacks have been stuck in the adversarial attack-defense arms race, reflect…