activity
20192023
most citedDissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numeric Behaviors

53 citations · 220 across the 27 of their papers we have counts for

collaborators
Showing 2022Show all

10 papers · 1 filter

cs.LG2022

Towards Real-Time Temporal Graph Learning

Deniz Gurevin, Mohsin Shan, Tong Geng +3

In recent years, graph representation learning has gained significant popularity, which aims to generate node embeddings that capture features of graphs. One of the methods to achi…

cs.CR2022★ 1 cited

PolyMPCNet: Towards ReLU-free Neural Architecture Search in Two-party Computation Based Private Inference

Hongwu Peng, Shanglin Zhou, Yukui Luo +10

The rapid growth and deployment of deep learning (DL) has witnessed emerging privacy and security concerns. To mitigate these issues, secure multi-party computation (MPC) has been…

cs.DC2022★ 7 cited

MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Multi-GPU Platforms

Yuke Wang, Boyuan Feng, Zheng Wang +4

The increasing size of input graphs for graph neural networks (GNNs) highlights the demand for using multi-GPU platforms. However, existing multi-GPU GNN systems optimize the compu…

cs.LG2022★ 2 cited

Towards Sparsification of Graph Neural Networks

Hongwu Peng, Deniz Gurevin, Shaoyi Huang +4

As real-world graphs expand in size, larger GNN models with billions of parameters are deployed. High parameter count in such models makes training and inference on graphs expensiv…

cs.LG2022★ 50 cited

A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining

Hongwu Peng, Shaoyi Huang, Shiyang Chen +8

Transformers are considered one of the most important deep learning models since 2018, in part because it establishes state-of-the-art (SOTA) records and could potentially replace…

cs.AR2022★ 1 cited

H-GCN: A Graph Convolutional Network Accelerator on Versal ACAP Architecture

Chengming Zhang, Tong Geng, Anqi Guo +4

Graph Neural Networks (GNNs) have drawn tremendous attention due to their unique capability to extend Machine Learning (ML) approaches to applications broadly-defined as having uns…

cs.DC2022

GMI-DRL: Empowering Multi-GPU Deep Reinforcement Learning with GPU Spatial Multiplexing

Yuke Wang, Boyuan Feng, Zheng Wang +3

With the increasing popularity of robotics in industrial control and autonomous driving, deep reinforcement learning (DRL) raises the attention of various fields. However, DRL comp…

cs.NE2022

GAAF: Searching Activation Functions for Binary Neural Networks through Genetic Algorithm

Yanfei Li, Tong Geng, Samuel Stein +2

Binary neural networks (BNNs) show promising utilization in cost and power-restricted domains such as edge devices and mobile systems. This is due to its significantly less computa…

cs.AR2022★ 53 cited

Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numeric Behaviors

Wei Sun, Ang Li, Tong Geng +2

Tensor Cores have been an important unit to accelerate Fused Matrix Multiplication Accumulation (MMA) in all NVIDIA GPUs since Volta Architecture. To program Tensor Cores, users ha…

cs.AR2022

I-GCN: A Graph Convolutional Network Accelerator with Runtime Locality Enhancement through Islandization

Tong Geng, Chunshu Wu, Yongan Zhang +6

Graph Convolutional Networks (GCNs) have drawn tremendous attention in the past three years. Compared with other deep learning modalities, high-performance hardware acceleration of…