15 citations · 47 across the 12 of their papers we have counts for
8 papers · 1 filter
Pinpointing the Memory Behaviors of DNN Training
Jiansong Li, Xiao Dong, Guangli Li +9
The training of deep neural networks (DNNs) is usually memory-hungry due to the limited device memory capacity of DNN accelerators. Characterizing the memory behaviors of DNN train…
HPC AI500: Representative, Repeatable and Simple HPC AI Benchmarking
Zihan Jiang, Wanling Gao, Fei Tang +6
Recent years witness a trend of applying large-scale distributed deep learning algorithms (HPC AI) in both business and scientific computing areas, whose goal is to speed up the tr…
HPC AI500: The Methodology, Tools, Roofline Performance Models, and Metrics for Benchmarking HPC AI Systems
Zihan Jiang, Lei Wang, Xingwang Xiong +6
The recent years witness a trend of applying large-scale distributed deep learning in both business and scientific computing areas, whose goal is to speed up the training time to a…
AIBench Scenario: Scenario-distilling AI Benchmarking
Wanling Gao, Fei Tang, Jianfeng Zhan +7
Modern real-world application scenarios like Internet services consist of a diversity of AI and non-AI modules with huge code sizes and long and complicated execution paths, which…
AIBench: An Agile Domain-specific Benchmarking Methodology and an AI Benchmark Suite
Wanling Gao, Fei Tang, Jianfeng Zhan +31
Domain-specific software and hardware co-design is encouraging as it is much easier to achieve efficiency for fewer tasks. Agile domain-specific benchmarking speeds up the process…
The Pitfall of Evaluating Performance on Emerging AI Accelerators
Zihan Jiang, Jiansong Li, Jiangfeng Zhan
In recent years, domain-specific hardware has brought significant performance improvements in deep learning (DL). Both industry and academia only focus on throughput when evaluatin…
HPC AI500: A Benchmark Suite for HPC AI Systems
Zihan Jiang, Wanling Gao, Lei Wang +10
In recent years, with the trend of applying deep learning (DL) in high performance scientific computing, the unique characteristics of emerging DL workloads in HPC raise great chal…
BOPS, Not FLOPS! A New Metric and Roofline Performance Model For Datacenter Computing
Lei Wang, Jianfeng Zhan, Wanling Gao +5
For emerging datacenter (in short, DC) workloads, such as online Internet services or offline data analytics, how to evaluate the upper bound performance and provide apple-to-apple…