4 papers · 1 filter
Zeta: Dual Whitening for Matrix Optimization via Coordinate-Adaptive Preconditioning
Kaiwen Chen, Shuhai Zhang, Zimo Liu +7
Large-scale neural network training increasingly relies on matrix-aware optimizers that exploit the structure of weight parameters beyond element-wise adaptation. However, existing…
ZeroSiam: An Efficient Asymmetry for Test-Time Entropy Optimization without Collapse
Guohao Chen, Shuaicheng Niu, Deyu Chen +5
Test-time entropy minimization helps adapt a model to novel environments and incentivize its reasoning capability, unleashing the model's potential during inference by allowing it…
Deep Electromagnetic Structure Design Under Limited Evaluation Budgets
Shijian Zheng, Fangxiao Jin, Shuhai Zhang +2
Electromagnetic structure (EMS) design plays a critical role in developing advanced antennas and materials, but remains challenging due to high-dimensional design spaces and expens…
Adversarial Purification by Consistency-aware Latent Space Optimization on Data Manifolds
Shuhai Zhang, Jiahao Yang, Hui Luo +5
Deep neural networks (DNNs) are vulnerable to adversarial samples crafted by adding imperceptible perturbations to clean data, potentially leading to incorrect and dangerous predic…