activity
20182022
most citedFrequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks

540 citations · 641 across the 6 of their papers we have counts for

collaborators

6 papers

cs.CR2022★ 54 cited

Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspective

Mark Huasong Meng, Guangdong Bai, Sin Gee Teo +4

Neural networks have been widely applied in security applications such as spam and phishing detection, intrusion prevention, and malware detection. This black-box method, however,…

cs.LG2021

Generalizing Neural Networks by Reflecting Deviating Data in Production

Yan Xiao, Yun Lin, Ivan Beschastnikh +3

Trained with a sufficiently large training and testing dataset, Deep Neural Networks (DNNs) are expected to generalize. However, inputs may deviate from the training dataset distri…

cs.SE2021

Self-Checking Deep Neural Networks in Deployment

Yan Xiao, Ivan Beschastnikh, David S. Rosenblum +4

The widespread adoption of Deep Neural Networks (DNNs) in important domains raises questions about the trustworthiness of DNN outputs. Even a highly accurate DNN will make mistakes…

cs.LG2019★ 540 cited

Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks

Zhi-Qin John Xu, Yaoyu Zhang, Tao Luo +2

We study the training process of Deep Neural Networks (DNNs) from the Fourier analysis perspective. We demonstrate a very universal Frequency Principle (F-Principle) -- DNNs often…

cs.IR2018

Beyond Precision: A Study on Recall of Initial Retrieval with Neural Representations

Yan Xiao, Jiafeng Guo, Yixing Fan +3

Vocabulary mismatch is a central problem in information retrieval (IR), i.e., the relevant documents may not contain the same (symbolic) terms of the query. Recently, neural repres…

cs.LG2018★ 47 cited

Training behavior of deep neural network in frequency domain

Zhi-Qin John Xu, Yaoyu Zhang, Yanyang Xiao

Why deep neural networks (DNNs) capable of overfitting often generalize well in practice is a mystery [#zhang2016understanding]. To find a potential mechanism, we focus on the stud…