1 citations · 1 across the 8 of their papers we have counts for
8 papers
Attention-Only White-Box Transformer via LeJEPA-Based Self-Supervised Pretraining
Yang Bai, Linyuan Wang, Haoyang Jiang +3
Existing studies on self-supervised learning for white-box networks typically decouple the derivation of white-box networks via optimization algorithms from self-supervised learnin…
A Quantization-Aware Training Based Lightweight Method for Neural Distinguishers
Guangwei Xiong, Linyuan Wang, Zhizhong Zheng +2
In 2019, Gohr pioneered the application of deep neural networks to differential cryptanalysis, developing DNN-based neural distinguisher classifiers to analyze the SPECK lightweigh…
Interpretable and Sparse Linear Attention with Decoupled Membership-Subspace Modeling via MCR2 Objective
Tianyuan Liu, Libin Hou, Linyuan Wang +1
Maximal Coding Rate Reduction (MCR2)-driven white-box transformer, grounded in structured representation learning, unifies interpretability and efficiency, providing a reliable whi…
MFI-ResNet: Efficient ResNet Architecture Optimization via MeanFlow Compression and Selective Incubation
Nuolin Sun, Linyuan Wang, Haonan Wei +2
ResNet has achieved tremendous success in computer vision through its residual connection mechanism. ResNet can be viewed as a discretized form of ordinary differential equations (…
Are classical deep neural networks weakly adversarially robust?
Nuolin Sun, Linyuan Wang, Dongyang Li +2
Adversarial attacks have received increasing attention and it has been widely recognized that classical DNNs have weak adversarial robustness. The most commonly used adversarial de…
Signal Adversarial Examples Generation for Signal Detection Network via White-Box Attack
Dongyang Li, Linyuan Wang, Guangwei Xiong +3
With the development and application of deep learning in signal detection tasks, the vulnerability of neural networks to adversarial attacks has also become a security threat to si…
Aligned with LLM: a new multi-modal training paradigm for encoding fMRI activity in visual cortex
Shuxiao Ma, Linyuan Wang, Senbao Hou +1
Recently, there has been a surge in the popularity of pre trained large language models (LLMs) (such as GPT-4), sweeping across the entire Natural Language Processing (NLP) and Com…
A Multimodal Visual Encoding Model Aided by Introducing Verbal Semantic Information
Shuxiao Ma, Linyuan Wang, Bin Yan
Biological research has revealed that the verbal semantic information in the brain cortex, as an additional source, participates in nonverbal semantic tasks, such as visual encodin…