76 citations · 120 across the 12 of their papers we have counts for
5 papers · 1 filter
From Human Guidance to Autonomy: Agent Skill System for End-to-End LLM Deployment on Spatial NPUs
Jiajie Li, Erwei Wang, Zhiru Zhang +1
Spatial neural processing units (NPUs) provide an energy-efficient platform for edge LLM inference, but efficiently deploying an LLM end-to-end on such hardware remains labor-inten…
GauS: Differentiable Scheduling Optimization via Gaussian Reparameterization
Yaohui Cai, Vesal Bakhtazad, Cunxi Yu +1
Efficient operator scheduling is a fundamental challenge in software compilation and hardware synthesis. While recent differentiable approaches have sought to replace traditional o…
Tawa: Automatic Warp Specialization for Modern GPUs with Asynchronous References
Hongzheng Chen, Bin Fan, Alexander Collins +8
Modern GPUs feature specialized hardware units that enable high-performance, asynchronous dataflow execution. However, the conventional SIMT programming model is fundamentally misa…
Trainable Fixed-Point Quantization for Deep Learning Acceleration on FPGAs
Dingyi Dai, Yichi Zhang, Jiahao Zhang +4
Quantization is a crucial technique for deploying deep learning models on resource-constrained devices, such as embedded FPGAs. Prior efforts mostly focus on quantizing matrix mult…
Understanding the Potential of FPGA-Based Spatial Acceleration for Large Language Model Inference
Hongzheng Chen, Jiahao Zhang, Yixiao Du +5
Recent advancements in large language models (LLMs) boasting billions of parameters have generated a significant demand for efficient deployment in inference workloads. The majorit…