24 citations · 28 across the 5 of their papers we have counts for
5 papers
Programming AMD XDNA NPUs with Open-source Compiler Tools: A FlashAttention Case Study
Erwei Wang, Ephrem Wu, Victor J. B. Jung +4
Spatial NPUs such as AMD XDNA place compute tiles beside small local memories and leave data movement between them to software. Mapping a multi-stage workload onto such a device is…
Ceiling-Clipped Acceptance Histograms Indicate Stranded Speed-up in Block-Diffusion Speculative Decoding
Ephrem Wu
Speculative decoding speeds up generation with an efficient draft model (drafter) that proposes tokens for a target model to verify in one pass, preserving the target's output dist…
ViBE: Co-Optimizing Workload Skew and Hardware Variability for MoE Serving
Seokjin Go, Marko Scrbak, Ephrem Wu +2
In distributed Mixture-of-Experts (MoE) inference, input-dependent token routing interacts with GPU performance variability to create persistent stragglers under synchronized execu…
Learning Accurate Integer Transformer Machine-Translation Models
Ephrem Wu
We describe a method for training accurate Transformer machine-translation models to run inference using 8-bit integer (INT8) hardware matrix multipliers, as opposed to the more co…
A Data-Center FPGA Acceleration Platform for Convolutional Neural Networks
Xiaoyu Yu, Yuwei Wang, Jie Miao +7
Intensive computation is entering data centers with multiple workloads of deep learning. To balance the compute efficiency, performance, and total cost of ownership (TCO), the use…