activity
20192023
most citedDissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numeric Behaviors

53 citations · 220 across the 27 of their papers we have counts for

collaborators

27 papers

cs.AR2023★ 2 cited

Accel-GCN: High-Performance GPU Accelerator Design for Graph Convolution Networks

Xi Xie, Hongwu Peng, Amit Hasan +7

Graph Convolutional Networks (GCNs) are pivotal in extracting latent information from graph data across various domains, yet their acceleration on mainstream GPUs is challenged by…

cs.CR2023

PASNet: Polynomial Architecture Search Framework for Two-party Computation-based Secure Neural Network Deployment

Hongwu Peng, Shanglin Zhou, Yukui Luo +9

Two-party computation (2PC) is promising to enable privacy-preserving deep learning (DL). However, the 2PC-based privacy-preserving DL implementation comes with high comparison pro…

cs.ET2023

Supporting Energy-Based Learning With An Ising Machine Substrate: A Case Study on RBM

Uday Kumar Reddy Vengalam, Yongchao Liu, Tong Geng +2

Nature apparently does a lot of computation constantly. If we can harness some of that computation at an appropriate level, we can potentially perform certain type of computation (…

cond-mat.dis-nn2023★ 18 cited

Machine Learning Automated Approach for Enormous Synchrotron X-Ray Diffraction Data Interpretation

Xiaodong Zhao, YiXuan Luo, Juejing Liu +6

Manual analysis of XRD data is usually laborious and time consuming. The deep neural network (DNN) based models trained by synthetic XRD patterns are proved to be an automatic, acc…

cs.CR2023★ 5 cited

RRNet: Towards ReLU-Reduced Neural Network for Two-party Computation Based Private Inference

Hongwu Peng, Shanglin Zhou, Yukui Luo +11

The proliferation of deep learning (DL) has led to the emergence of privacy and security concerns. To address these issues, secure Two-party computation (2PC) has been proposed as…

cs.LG2022

Towards Real-Time Temporal Graph Learning

Deniz Gurevin, Mohsin Shan, Tong Geng +3

In recent years, graph representation learning has gained significant popularity, which aims to generate node embeddings that capture features of graphs. One of the methods to achi…

cs.CR2022★ 1 cited

PolyMPCNet: Towards ReLU-free Neural Architecture Search in Two-party Computation Based Private Inference

Hongwu Peng, Shanglin Zhou, Yukui Luo +10

The rapid growth and deployment of deep learning (DL) has witnessed emerging privacy and security concerns. To mitigate these issues, secure multi-party computation (MPC) has been…

cs.DC2022★ 7 cited

MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Multi-GPU Platforms

Yuke Wang, Boyuan Feng, Zheng Wang +4

The increasing size of input graphs for graph neural networks (GNNs) highlights the demand for using multi-GPU platforms. However, existing multi-GPU GNN systems optimize the compu…

cs.LG2022★ 2 cited

Towards Sparsification of Graph Neural Networks

Hongwu Peng, Deniz Gurevin, Shaoyi Huang +4

As real-world graphs expand in size, larger GNN models with billions of parameters are deployed. High parameter count in such models makes training and inference on graphs expensiv…

cs.LG2022★ 50 cited

A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining

Hongwu Peng, Shaoyi Huang, Shiyang Chen +8

Transformers are considered one of the most important deep learning models since 2018, in part because it establishes state-of-the-art (SOTA) records and could potentially replace…

cs.AR2022★ 1 cited

H-GCN: A Graph Convolutional Network Accelerator on Versal ACAP Architecture

Chengming Zhang, Tong Geng, Anqi Guo +4

Graph Neural Networks (GNNs) have drawn tremendous attention due to their unique capability to extend Machine Learning (ML) approaches to applications broadly-defined as having uns…

cs.DC2022

GMI-DRL: Empowering Multi-GPU Deep Reinforcement Learning with GPU Spatial Multiplexing

Yuke Wang, Boyuan Feng, Zheng Wang +3

With the increasing popularity of robotics in industrial control and autonomous driving, deep reinforcement learning (DRL) raises the attention of various fields. However, DRL comp…

cs.NE2022

GAAF: Searching Activation Functions for Binary Neural Networks through Genetic Algorithm

Yanfei Li, Tong Geng, Samuel Stein +2

Binary neural networks (BNNs) show promising utilization in cost and power-restricted domains such as edge devices and mobile systems. This is due to its significantly less computa…

cs.AR2022★ 53 cited

Dissecting Tensor Cores via Microbenchmarks: Latency, Throughput and Numeric Behaviors

Wei Sun, Ang Li, Tong Geng +2

Tensor Cores have been an important unit to accelerate Fused Matrix Multiplication Accumulation (MMA) in all NVIDIA GPUs since Volta Architecture. To program Tensor Cores, users ha…

cs.AR2022

I-GCN: A Graph Convolutional Network Accelerator with Runtime Locality Enhancement through Islandization

Tong Geng, Chunshu Wu, Yongan Zhang +6

Graph Convolutional Networks (GCNs) have drawn tremendous attention in the past three years. Compared with other deep learning modalities, high-performance hardware acceleration of…

cs.AR2021★ 1 cited

GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Design

Haoran You, Tong Geng, Yongan Zhang +2

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art graph learning model. However, it can be notoriously challenging to inference GCNs over large graph dataset…

cs.AR2021★ 3 cited

G-CoS: GNN-Accelerator Co-Search Towards Both Better Accuracy and Efficiency

Yongan Zhang, Haoran You, Yonggan Fu +3

Graph Neural Networks (GNNs) have emerged as the state-of-the-art (SOTA) method for graph-based learning tasks. However, it still remains prohibitively challenging to inference GNN…

cs.AR2021★ 1 cited

Optimizing FPGA-based Accelerator Design for Large-Scale Molecular Similarity Search

Hongwu Peng, Shiyang Chen, Zhepeng Wang +9

Molecular similarity search has been widely used in drug discovery to identify structurally similar compounds from large molecular databases rapidly. With the increasing size of ch…

cs.LG2021★ 4 cited

Binary Complex Neural Network Acceleration on FPGA

Hongwu Peng, Shanglin Zhou, Scott Weitze +9

Being able to learn from complex data with phase information is imperative for many signal processing applications. Today' s real-valued deep neural networks (DNNs) have shown effi…

cs.DC2021★ 8 cited

CEAZ: Accelerating Parallel I/O via Hardware-Algorithm Co-Designed Adaptive Lossy Compression

Chengming Zhang, Sian Jin, Tong Geng +3

As HPC systems continue to grow to exascale, the amount of data that needs to be saved or transmitted is exploding. To this end, many previous works have studied using error-bounde…

cs.DC2021★ 1 cited

APNN-TC: Accelerating Arbitrary Precision Neural Networks on Ampere GPU Tensor Cores

Boyuan Feng, Yuke Wang, Tong Geng +2

Over the years, accelerating neural networks with quantization has been widely studied. Unfortunately, prior efforts with diverse precisions (e.g., 1-bit weights and 2-bit activati…

cs.NE2021★ 2 cited

BCNN: Binary Complex Neural Network

Yanfei Li, Tong Geng, Ang Li +1

Binarized neural networks, or BNNs, show great promise in edge-side applications with resource limited hardware, but raise the concerns of reduced accuracy. Motivated by the comple…

cs.DC2020★ 2 cited

ARENA: Asynchronous Reconfigurable Accelerator Ring to Enable Data-Centric Parallel Computing

Cheng Tan, Chenhao Xie, Tong Geng +4

The next generation HPC and data centers are likely to be reconfigurable and data-centric due to the trend of hardware specialization and the emergence of data-driven applications.…

cs.DC2020★ 18 cited

CSB-RNN: A Faster-than-Realtime RNN Acceleration Framework with Compressed Structured Blocks

Runbin Shi, Peiyan Dong, Tong Geng +6

Recurrent neural networks (RNNs) have been widely adopted in temporal sequence analysis, where realtime performance is often in demand. However, RNNs suffer from heavy computationa…