5 citations · 10 across the 11 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.LG2024
Hyper-Compression: Model Compression via Hyperfunction
Fenglei Fan, Juntong Fan, Dayang Wang +5
The rapid growth of large models' size has far outpaced that of computing resources. To bridge this gap, encouraged by the parsimonious relationship between genotype and phenotype…
cs.CV2024★ 2 cited
Don't Fear Peculiar Activation Functions: EUAF and Beyond
Qianchao Wang, Shijun Zhang, Dong Zeng +4
In this paper, we propose a new super-expressive activation function called the Parametric Elementary Universal Activation Function (PEUAF). We demonstrate the effectiveness of PEU…
cs.LG2024
Structured and Balanced Multi-Component and Multi-Layer Neural Networks
Shijun Zhang, Hongkai Zhao, Yimin Zhong +1
In this work, we propose a balanced multi-component and multi-layer neural network (MMNN) structure to accurately and efficiently approximate functions with complex features, in te…