4 papers · 1 filter
Spark Transformer: Reactivating Sparsity in FFN and Attention
Chong You, Kan Wu, Zhipeng Jia +16
The discovery of the lazy neuron phenomenon in trained Transformers, where the vast majority of neurons in their feed-forward networks (FFN) are inactive for each token, has spurre…
RainSeer: Fine-Grained Rainfall Reconstruction via Physics-Guided Modeling
Lin Chen, Jun Chen, Minghui Qiu +3
Reconstructing high-resolution rainfall fields is essential for flood forecasting, hydrological modeling, and climate analysis. However, existing spatial interpolation methods-whet…
Efficient Privacy-Preserving KAN Inference Using Homomorphic Encryption
Zhizheng Lai, Yufei Zhou, Peijia Zheng +1
The recently proposed Kolmogorov-Arnold Networks (KANs) offer enhanced interpretability and greater model expressiveness. However, KANs also present challenges related to privacy l…
Optimistic Rates for Learning from Label Proportions
Gene Li, Lin Chen, Adel Javanmard +1
We consider a weakly supervised learning problem called Learning from Label Proportions (LLP), where examples are grouped into ``bags'' and only the average label within each bag i…