Yanke Song

activity

20242026

collaborators

Showing cs.LGShow all

3 papers · 1 filter

cs.LG2026

Hardware Co-Design Scaling Laws via Roofline Modelling for On-Device LLMs

Luoyang Sun, Jiwen Jiang, Yifeng Ding +9

Vision-Language-Action Models (VLAs) have emerged as a key paradigm of Physical AI and are increasingly deployed in autonomous vehicles, robots, and smart spaces. In these resource…

cs.LG2026

From $O (mn)$ to $O (r^{2})$ : Two-Sided Low-Rank Communication for Adam in Distributed Training with Memory Efficiency

Sizhe Dang, Jiaqi Shao, Xiaodong Zheng +3

As foundation models continue to scale, pretraining increasingly relies on data-parallel distributed optimization, making bandwidth-limited gradient synchronization a key bottlenec…

cs.LG2024

Multi-student Diffusion Distillation for Better One-step Generators

Yanke Song, Jonathan Lorraine, Weili Nie +2

Diffusion models achieve high-quality sample generation at the cost of a lengthy multistep inference procedure. To overcome this, diffusion distillation techniques produce student…

Hardware Co-Design Scaling Laws via Roofline Modelling for On-Device LLMs

From O(mn) to O(r2): Two-Sided Low-Rank Communication for Adam in Distributed Training with Memory Efficiency

Multi-student Diffusion Distillation for Better One-step Generators

From $O (mn)$ to $O (r^{2})$ : Two-Sided Low-Rank Communication for Adam in Distributed Training with Memory Efficiency