Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Asynchronous Heavy-Tailed Optimization
Junfei Sun, Dixi Yao, Xuchen Gong +3
Heavy-tailed stochastic gradient noise, commonly observed in transformer models, can destabilize the optimization process. Recent works mainly focus on developing and understanding…
cs.CV2026
Amber-Image: Efficient Compression of Large-Scale Diffusion Transformers
Chaojie Yang, Tian Li, Yue Zhang +1
Diffusion Transformer (DiT) architectures have significantly advanced Text-to-Image (T2I) generation but suffer from prohibitive computational costs and deployment barriers. To add…