4 papers
DeepCEE: Efficient Cross-Region Model Distributed Training System under Heterogeneous GPUs and Networks
Jinquan Wang, Xiaojian Liao, Xuzhao Liu +7
Most existing training systems focus on a single region. In contrast, we envision that cross-region training offers more flexible GPU resource allocation and yields significant pot…
FineQ: Software-Hardware Co-Design for Low-Bit Fine-Grained Mixed-Precision Quantization of LLMs
Xilong Xie, Liang Wang, Limin Xiao +4
Large language models (LLMs) have significantly advanced the natural language processing paradigm but impose substantial demands on memory and computational resources. Quantization…
ATA-Cache: Contention Mitigation for GPU Shared L1 Cache with Aggregated Tag Array
Xiangrong Xu, Liang Wang, Limin Xiao +4
GPU shared L1 cache is a promising architecture while still suffering from high resource contentions. We present a GPU shared L1 cache architecture with an aggregated tag array tha…
ReDas: A Lightweight Architecture for Supporting Fine-Grained Reshaping and Multiple Dataflows on Systolic Array
Meng Han, Liang Wang, Limin Xiao +4
The systolic accelerator is one of the premier architectural choices for DNN acceleration. However, the conventional systolic architecture suffers from low PE utilization due to th…