5 citations · 8 across the 21 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.LG2026
Towards the Connection between Activation Sparsity and Flat Minima
Ze Peng, Jian Zhang, Lei Qi +2
The observation that activation sparsity emerges in MLP blocks of standardly trained Transformers offers an opportunity to drastically reduce computation costs without sacrificing…
cs.CR2026
Architecture-Agnostic Feature Synergy for Universal Defense Against Heterogeneous Generative Threats
Bingxue Zhang, Yang Gao, Feida Zhu +2
Generative AI deployment poses unprecedented challenges to content safety and privacy. However, existing defense mechanisms are often tailored to specific architectures (e.g., Diff…
cs.LG2026
Leveraging Flatness to Improve Information-Theoretic Generalization Bounds for SGD
Ze Peng, Jian Zhang, Yisen Wang +3
Information-theoretic (IT) generalization bounds have been used to study the generalization of learning algorithms. These bounds are intrinsically data- and algorithm-dependent so…