1 citations · 1 across the 8 of their papers we have counts for
6 papers · 1 filter
How Does Parameter Pruning Reshape DNN Representations? An Interaction-Driven Exploration
Fangbo Li, Junpeng Zhang, Qihan Ren +1
This study focuses on the scientific problem of understanding internal factors that govern the diverse performance degradation of deep neural networks (DNNs) when different paramet…
Technical Report: Quantifying and Analyzing the Generalization Power of a DNN
Yuxuan He, Junpeng Zhang, Lei Cheng +2
This paper proposes a new perspective for analyzing the generalization power of deep neural networks (DNNs), i.e., directly disentangling and analyzing the dynamics of generalizabl…
Revisiting Generalization Power of a DNN in Terms of Symbolic Interactions
Lei Cheng, Junpeng Zhang, Qihan Ren +1
This paper aims to analyze the generalization power of deep neural networks (DNNs) from the perspective of interactions. Unlike previous analysis of a DNN's generalization power in…
Randomness of Low-Layer Parameters Determines Confusing Samples in Terms of Interaction Representations of a DNN
Junpeng Zhang, Lei Cheng, Qing Li +2
In this paper, we find that the complexity of interactions encoded by a deep neural network (DNN) can explain its generalization power. We also discover that the confusing samples…
Quantifying In-Context Reasoning Effects and Memorization Effects in LLMs
Siyu Lou, Yuntian Chen, Xiaodan Liang +2
In this study, we propose an axiomatic system to define and quantify the precise memorization and in-context reasoning effects used by the large language model (LLM) for language g…
Two-Phase Dynamics of Interactions Explains the Starting Point of a DNN Learning Over-Fitted Features
Junpeng Zhang, Qing Li, Liang Lin +1
This paper investigates the dynamics of a deep neural network (DNN) learning interactions. Previous studies have discovered and mathematically proven that given each input sample,…