1 citations · 2 across the 8 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.PL2026
DITRON: Distributed Multi-level Tiling Compiler for Parallel Tensor Programs
Size Zheng, Xuegui Zheng, Hanshi Sun +16
The scaling of large language models (LLMs) is currently bottlenecked by the rigidity of distributed programming. While high-performance libraries like CuBLAS and NCCL provide opti…
cs.DC2026
UniEP: Unified Expert-Parallel MoE MegaKernel for LLM Training
Size Zheng, Xuegui Zheng, Li-wen Chang +1
The exponential growth in Large Language Model (LLM) parameters has transformed model training into an increasingly resource-intensive endeavor. With the stagnation of Moore's Law…