4 papers
RainSeer: Fine-Grained Rainfall Reconstruction via Physics-Guided Modeling
Lin Chen, Jun Chen, Minghui Qiu +3
Reconstructing high-resolution rainfall fields is essential for flood forecasting, hydrological modeling, and climate analysis. However, existing spatial interpolation methods-whet…
Spark Transformer: Reactivating Sparsity in FFN and Attention
Chong You, Kan Wu, Zhipeng Jia +16
The discovery of the lazy neuron phenomenon in trained Transformers, where the vast majority of neurons in their feed-forward networks (FFN) are inactive for each token, has spurre…
A Survey of Quantum Transformers: Architectures, Challenges and Outlooks
Hui Zhang, Qinglin Zhao, Mengchu Zhou +4
Quantum Transformers integrate the representational power of classical Transformers with the computational advantages of quantum computing. Since 2022, research in this area has ra…
Efficient Privacy-Preserving KAN Inference Using Homomorphic Encryption
Zhizheng Lai, Yufei Zhou, Peijia Zheng +1
The recently proposed Kolmogorov-Arnold Networks (KANs) offer enhanced interpretability and greater model expressiveness. However, KANs also present challenges related to privacy l…