activity
20192022
most citedDiscovering and Explaining the Representation Bottleneck of DNNs

16 citations · 60 across the 13 of their papers we have counts for

collaborators
Showing cs.LGShow all

13 papers · 1 filter

cs.LG2022★ 2 cited

Proving Common Mechanisms Shared by Twelve Methods of Boosting Adversarial Transferability

Quanshi Zhang, Xin Wang, Jie Ren +4

Although many methods have been proposed to enhance the transferability of adversarial perturbations, these methods are designed in a heuristic manner, and the essential mechanism…

cs.LG2022★ 2 cited

Why Adversarial Training of ReLU Networks Is Difficult?

Xu Cheng, Hao Zhang, Yue Xin +3

This paper mathematically derives an analytic solution of the adversarial perturbation on a ReLU network, and theoretically explains the difficulty of adversarial training. Specifi…

cs.LG2022★ 1 cited

Towards Theoretical Analysis of Transformation Complexity of ReLU DNNs

Jie Ren, Mingjie Li, Meng Zhou +2

This paper aims to theoretically analyze the complexity of feature transformations encoded in piecewise linear DNNs with ReLU layers. We propose metrics to measure three types of c…

cs.LG2021★ 2 cited

Trap of Feature Diversity in the Learning of MLPs

Dongrui Liu, Shaobo Wang, Jie Ren +4

In this paper, we focus on a typical two-phase phenomenon in the learning of multi-layer perceptrons (MLPs), and we aim to explain the reason for the decrease of feature diversity…

cs.LG2021

A Unified Game-Theoretic Interpretation of Adversarial Robustness

Jie Ren, Die Zhang, Yisen Wang +8

This paper provides a unified view to explain different adversarial attacks and defense methods, \emph{i.e.} the view of multi-order interactions between input variables of DNNs. B…

cs.LG2021★ 16 cited

Discovering and Explaining the Representation Bottleneck of DNNs

Huiqi Deng, Qihan Ren, Hao Zhang +1

This paper explores the bottleneck of feature representations of deep neural networks (DNNs), from the perspective of the complexity of interactions between input variables encoded…

cs.LG2021★ 2 cited

Proceedings of ICML 2021 Workshop on Theoretic Foundation, Criticism, and Application Trend of Explainable AI

Quanshi Zhang, Tian Han, Lixin Fan +5

This is the Proceedings of ICML 2021 Workshop on Theoretic Foundation, Criticism, and Application Trend of Explainable AI. Deep neural networks (DNNs) have undoubtedly brought grea…

cs.LG2021★ 7 cited

A Game-Theoretic Taxonomy of Visual Concepts in DNNs

Xu Cheng, Chuntung Chu, Yi Zheng +2

In this paper, we rethink how a DNN encodes visual concepts of different complexities from a new perspective, i.e. the game-theoretic multi-order interactions between pixels in an…

cs.LG2021★ 3 cited

Probabilistic Mixture-of-Experts for Efficient Deep Reinforcement Learning

Jie Ren, Yewen Li, Zihan Ding +2

Deep reinforcement learning (DRL) has successfully solved various problems recently, typically with a unimodal policy representation. However, grasping distinguishable skills for s…

cs.LG2021★ 2 cited

A Unified Game-Theoretic Interpretation of Adversarial Robustness

Jie Ren, Die Zhang, Yisen Wang +8

This paper provides a unified view to explain different adversarial attacks and defense methods, i.e. the view of multi-order interactions between input variables of DNNs. Based on…

cs.LG2020★ 15 cited

A Unified Approach to Interpreting and Boosting Adversarial Transferability

Xin Wang, Jie Ren, Shuyun Lin +3

In this paper, we use the interaction inside adversarial perturbations to explain and boost the adversarial transferability. We discover and prove the negative correlation between…

cs.LG2020★ 2 cited

Interpreting and Disentangling Feature Components of Various Complexity from DNNs

Jie Ren, Mingjie Li, Zexu Liu +1

This paper aims to define, quantify, and analyze the feature complexity that is learned by a DNN. We propose a generic definition for the feature complexity. Given the feature of a…

cs.LG2019★ 6 cited

Interpretable Complex-Valued Neural Networks for Privacy Protection

Liyao Xiang, Haotian Ma, Hao Zhang +3

Previous studies have found that an adversary attacker can often infer unintended input information from intermediate-layer features. We study the possibility of preventing such ad…