2 citations · 5 across the 7 of their papers we have counts for
3 papers · 1 filter
EMoE: Eigenbasis-Guided Routing for Mixture-of-Experts
Anzhe Cheng, Shukai Duan, Shixuan Li +5
The relentless scaling of deep learning models has led to unsustainable computational demands, positioning Mixture-of-Experts (MoE) architectures as a promising path towards greate…
A Structure-Aware Framework for Learning Device Placements on Computation Graphs
Shukai Duan, Heng Ping, Nikos Kanakaris +9
Computation graphs are Directed Acyclic Graphs (DAGs) where the nodes correspond to mathematical operations and are used widely as abstractions in optimizations of neural networks.…
PerfRL: A Small Language Model Framework for Efficient Code Optimization
Shukai Duan, Nikos Kanakaris, Xiongye Xiao +8
Code optimization is a challenging task requiring a substantial level of expertise from developers. Nonetheless, this level of human capacity is not sufficient considering the rapi…