activity
20232026
most citedAsymmetric Momentum: A Rethinking of Gradient Descent

2 citations · 2 across the 5 of their papers we have counts for

collaborators

5 papers

cs.RO2026

HaptiNet: Networked Haptic Robots Enable Physical Co-presence in Geographically-Unconstrained Rehabilitation

Chenyang Sun, Mingjie Dong, Haodong Deng +18

Cooperative rehabilitation enhances engagement, task performance, and social-motor interaction, yet it demands physical co-presence: users must transmit forces, coordinate movement…

cs.LG2026

Hidden Boundary Motion in Transformer Optimization: Function-Space Orthogonalization of Affine Weight and Bias Updates

Zhang Gongyue, Sheng Yixuan, Liu donghan +3

Weights and biases are normally optimized as separate parameter tensors, yet they do not represent separate functions when the input to an affine layer has nonzero mean. For an aff…

cs.LG2026

The Anatomy of Implicit Bias: Information Allocation in Neural Network Training

Zhang Gongyue, Wang Zhiyong, Liu Donghan +3

Implicit bias is usually explained as the preference of an optimization process for certain final solutions and their geometry. This view helps explain where a model finally stops.…

eess.IV2024

Online 4D Ultrasound-Guided Robotic Tracking Enables 3D Ultrasound Localisation Microscopy with Large Tissue Displacements

Jipeng Yan, Qingyuan Tan, Shusei Kawara +6

Super-Resolution Ultrasound (SRUS) imaging through localising and tracking microbubbles, also known as Ultrasound Localisation Microscopy (ULM), has demonstrated significant potent…

cs.LG2023★ 2 cited

Asymmetric Momentum: A Rethinking of Gradient Descent

Gongyue Zhang, Dinghuang Zhang, Shuwen Zhao +3

Through theoretical and experimental validation, unlike all existing adaptive methods like Adam which penalize frequently-changing parameters and are only applicable to sparse grad…