3 citations · 6 across the 6 of their papers we have counts for
Showing 2025Show all
2 papers · 1 filter
math.NA2025
Design Criteria for SGD Preconditioners: Local Conditioning, Noise Floors, and Basin Stability
Mitchell Scott, Tianshi Xu, Ziyuan Tang +4
Stochastic Gradient Descent (SGD) often slows in the late stage of training due to anisotropic curvature and gradient noise. We analyze preconditioned SGD in the geometry induced b…
cs.LG2025
Toward a Graph Foundation Model: Pre-Training Transformers With Random Walks
Ziyuan Tang, Jie Chen
A foundation model like GPT elicits many emergent abilities, owing to the pre-training with broad inclusion of data and the use of the powerful Transformer architecture. While foun…